Aug 27 04:54:09 user nova-compute[72904]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 27 04:54:12 user nova-compute[72904]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72904) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72904) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72904) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 27 04:54:12 user nova-compute[72904]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:54:12 user nova-compute[72904]: INFO nova.virt.driver [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 27 04:54:12 user nova-compute[72904]: INFO nova.compute.provider_config [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Acquiring lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Acquired lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Releasing lock "singleton_lock" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Full set of CONF: {{(pid=72904) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ******************************************************************************** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Configuration options gathered from: {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ================================================================================ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] allow_resize_to_same_host      = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] arq_binding_timeout            = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] backdoor_port                  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] backdoor_socket                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] block_device_allocate_retries  = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] block_device_allocate_retries_interval = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cert                           = self.pem {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute_monitors               = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] config_dir                     = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] config_drive_format            = iso9660 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] config_source                  = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] console_host                   = user {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] control_exchange               = nova {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cpu_allocation_ratio           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] daemon                         = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] debug                          = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] default_access_ip_network_name = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] default_availability_zone      = nova {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] default_ephemeral_format       = ext4 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] default_green_pool_size        = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] default_schedule_zone          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] disk_allocation_ratio          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] enable_new_services            = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] enabled_ssl_apis               = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] flat_injected                  = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] force_config_drive             = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] force_raw_images               = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] graceful_shutdown_timeout      = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] heal_instance_info_cache_interval = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] host                           = user {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instance_build_timeout         = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instance_delete_interval       = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instance_name_template         = instance-%08x {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instance_usage_audit           = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instance_usage_audit_period    = month {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] internal_service_availability_zone = internal {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] key                            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] live_migration_retry_count     = 30 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_config_append              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_dir                        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_file                       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_options                    = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_rotate_interval            = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_rotate_interval_type       = days {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] log_rotation_type              = none {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] long_rpc_timeout               = 1800 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] max_concurrent_builds          = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] max_concurrent_live_migrations = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] max_concurrent_snapshots       = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] max_local_block_devices        = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] max_logfile_count              = 30 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] max_logfile_size_mb            = 200 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] maximum_instance_delete_attempts = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] metadata_listen                = 0.0.0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] metadata_listen_port           = 8775 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] metadata_workers               = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] migrate_max_retries            = -1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] mkisofs_cmd                    = genisoimage {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] my_ip                          = 10.0.0.210 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] network_allocate_retries       = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] osapi_compute_listen_port      = 8774 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] osapi_compute_unique_server_name_scope =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] osapi_compute_workers          = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] password_length                = 12 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] periodic_enable                = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] periodic_fuzzy_delay           = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] pointer_model                  = ps2mouse {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] preallocate_images             = none {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] publish_errors                 = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] pybasedir                      = /opt/stack/nova {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ram_allocation_ratio           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rate_limit_burst               = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rate_limit_except_level        = CRITICAL {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rate_limit_interval            = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] reboot_timeout                 = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] reclaim_instance_interval      = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] record                         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] reimage_timeout_per_gb         = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] report_interval                = 120 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rescue_timeout                 = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] reserved_host_cpus             = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] reserved_host_disk_mb          = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] reserved_host_memory_mb        = 512 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] reserved_huge_pages            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] resize_confirm_window          = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] resize_fs_using_block_device   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] resume_guests_state_on_host_boot = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rpc_response_timeout           = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] run_external_periodic_tasks    = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] running_deleted_instance_action = reap {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] running_deleted_instance_timeout = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler_instance_sync_interval = 120 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_down_time              = 720 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] servicegroup_driver            = db {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] shelved_offload_time           = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] shelved_poll_interval          = 3600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:12 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] shutdown_timeout               = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] source_is_ipv6                 = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ssl_only                       = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] state_path                     = /opt/stack/data/nova {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] sync_power_state_interval      = 600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] sync_power_state_pool_size     = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] syslog_log_facility            = LOG_USER {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] tempdir                        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] timeout_nbd                    = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] transport_url                  = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] update_resources_interval      = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] use_cow_images                 = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] use_eventlog                   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] use_journal                    = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] use_json                       = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] use_rootwrap_daemon            = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] use_stderr                     = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] use_syslog                     = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vcpu_pin_set                   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plugging_is_fatal          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plugging_timeout           = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] virt_mkfs                      = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] volume_usage_poll_interval     = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] watch_log_file                 = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] web                            = /usr/share/spice-html5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_concurrency.disable_process_locking = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.auth_strategy              = keystone {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.compute_link_prefix        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.dhcp_domain                = novalocal {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.enable_instance_password   = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.glance_link_prefix         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.instance_list_per_project_cells = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.list_records_by_skipping_down_cells = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.local_metadata_per_cell    = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.max_limit                  = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.metadata_cache_expiration  = 15 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.neutron_default_tenant_id  = default {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.use_forwarded_for          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.use_neutron_default_nets   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.vendordata_dynamic_targets = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.vendordata_jsonfile_path   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.backend_argument         = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.config_prefix            = cache.oslo {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.dead_timeout             = 60.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.debug_cache_backend      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.enable_retry_client      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.enable_socket_keepalive  = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.enabled                  = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.expiration_time          = 600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.hashclient_retry_attempts = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_dead_retry      = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_password        =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_sasl_enabled    = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.memcache_username        =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.proxies                  = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.retry_attempts           = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.retry_delay              = 0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.socket_keepalive_count   = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.socket_keepalive_idle    = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.socket_keepalive_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.tls_allowed_ciphers      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.tls_cafile               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.tls_certfile             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.tls_enabled              = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cache.tls_keyfile              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.auth_section            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.auth_type               = password {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.cafile                  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.certfile                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.collect_timing          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.cross_az_attach         = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.debug                   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.endpoint_template       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.http_retries            = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.insecure                = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.keyfile                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.os_region_name          = RegionOne {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.split_loggers           = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cinder.timeout                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.cpu_dedicated_set      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.cpu_shared_set         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.image_type_exclude_list = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.resource_provider_association_refresh = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.shutdown_retry_interval = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] conductor.workers              = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] console.allowed_origins        = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] console.ssl_ciphers            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] console.ssl_minimum_version    = default {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] consoleauth.token_ttl          = 600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.cafile                  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.certfile                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.collect_timing          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.connect_retries         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.connect_retry_delay     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.endpoint_override       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.insecure                = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.keyfile                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.max_version             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.min_version             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.region_name             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.service_name            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.service_type            = accelerator {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.split_loggers           = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.status_code_retries     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.status_code_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.timeout                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] cyborg.version                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.backend               = sqlalchemy {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.connection            = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.connection_debug      = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.connection_parameters =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.connection_recycle_time = 3600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.connection_trace      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.db_inc_retry_interval = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.db_max_retries        = 20 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.db_max_retry_interval = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.db_retry_interval     = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.max_overflow          = 50 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.max_pool_size         = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.max_retries           = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.mysql_enable_ndb      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.mysql_wsrep_sync_wait = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.pool_timeout          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.retry_interval        = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.slave_connection      = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] database.sqlite_synchronous    = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.backend           = sqlalchemy {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.connection        = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.connection_debug  = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.connection_parameters =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.connection_recycle_time = 3600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.connection_trace  = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.db_inc_retry_interval = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.db_max_retries    = 20 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.db_max_retry_interval = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.db_retry_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.max_overflow      = 50 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.max_pool_size     = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.max_retries       = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.mysql_enable_ndb  = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.pool_timeout      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.retry_interval    = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.slave_connection  = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] api_database.sqlite_synchronous = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] devices.enabled_mdev_types     = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ephemeral_storage_encryption.enabled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.api_servers             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.cafile                  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.certfile                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.collect_timing          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.connect_retries         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.connect_retry_delay     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.debug                   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.default_trusted_certificate_ids = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.enable_certificate_validation = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.enable_rbd_download     = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.endpoint_override       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.insecure                = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.keyfile                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.max_version             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.min_version             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.num_retries             = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.rbd_ceph_conf           =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.rbd_connect_timeout     = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.rbd_pool                =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.rbd_user                =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.region_name             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.service_name            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.service_type            = image {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.split_loggers           = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.status_code_retries     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.status_code_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.timeout                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.verify_glance_signatures = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] glance.version                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] guestfs.debug                  = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.config_drive_cdrom      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.config_drive_inject_password = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.enable_remotefx         = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.instances_path_share    =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.limit_cpu_features      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.use_multipath_io        = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.vswitch_name            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] mks.enabled                    = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] image_cache.manager_interval   = 2400 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] image_cache.precache_concurrency = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] image_cache.remove_unused_base_images = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] image_cache.subdirectory_name  = _base {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.api_max_retries         = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.api_retry_interval      = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.auth_section            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.auth_type               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.cafile                  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.certfile                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.collect_timing          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.connect_retries         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.connect_retry_delay     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.endpoint_override       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.insecure                = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.keyfile                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.max_version             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.min_version             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.partition_key           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.peer_list               = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.region_name             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.serial_console_state_timeout = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.service_name            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.service_type            = baremetal {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.split_loggers           = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.status_code_retries     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.status_code_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.timeout                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ironic.version                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] key_manager.fixed_key          = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.barbican_api_version  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.barbican_endpoint     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.barbican_endpoint_type = public {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.barbican_region_name  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.cafile                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.certfile              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.collect_timing        = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.insecure              = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.keyfile               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.number_of_retries     = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.retry_delay           = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.send_service_user_token = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.split_loggers         = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.timeout               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.verify_ssl            = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican.verify_ssl_path       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.auth_section = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.auth_type = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.cafile   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.collect_timing = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.keyfile  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.split_loggers = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] barbican_service_user.timeout  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.approle_role_id          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.approle_secret_id        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.cafile                   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.certfile                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.collect_timing           = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.insecure                 = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.keyfile                  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.kv_mountpoint            = secret {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.kv_version               = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.namespace                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.root_token_id            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.split_loggers            = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.ssl_ca_crt_file          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.timeout                  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.use_ssl                  = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.cafile                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.certfile              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.collect_timing        = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.connect_retries       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.connect_retry_delay   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.endpoint_override     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.insecure              = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.keyfile               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.max_version           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.min_version           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.region_name           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.service_name          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.service_type          = identity {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.split_loggers         = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.status_code_retries   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.status_code_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.timeout               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] keystone.version               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.connection_uri         =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.cpu_mode               = custom {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: WARNING oslo_config.cfg [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.cpu_power_governor_high = performance {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.cpu_power_management   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.device_detach_attempts = 8 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.device_detach_timeout  = 20 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.disk_cachemodes        = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.disk_prefix            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.enabled_perf_events    = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.file_backed_memory     = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.gid_maps               = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.hw_disk_discard        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.hw_machine_type        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.images_rbd_pool        = rbd {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.images_type            = default {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.images_volume_group    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.inject_key             = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.inject_partition       = -2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.inject_password        = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.iscsi_iface            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.iser_use_multipath     = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_downtime = 500 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_inbound_addr = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_scheme  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_timeout_action = abort {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_tunnelled = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: WARNING oslo_config.cfg [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 27 04:54:13 user nova-compute[72904]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 27 04:54:13 user nova-compute[72904]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 27 04:54:13 user nova-compute[72904]: and ``live_migration_inbound_addr`` respectively.
Aug 27 04:54:13 user nova-compute[72904]: ).  Its value may be silently ignored in the future.
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.live_migration_with_native_tls = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.max_queues             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.nfs_mount_options      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.num_pcie_ports         = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.pmem_namespaces        = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.quobyte_client_cfg     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rbd_secret_uuid        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rbd_user               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rescue_image_id        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rescue_kernel_id       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.rx_queue_size          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.smbfs_mount_options    =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.snapshot_compression   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.snapshot_image_format  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.sparse_logical_volumes = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.swtpm_enabled          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.swtpm_group            = tss {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.swtpm_user             = tss {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.sysinfo_serial         = unique {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.tb_cache_size          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.tx_queue_size          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.uid_maps               = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.use_virtio_for_bridges = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.virt_type              = kvm {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.volume_clear           = zero {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.volume_clear_size      = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.volume_use_multipath   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.vzstorage_cache_path   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.auth_section           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.auth_type              = password {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.cafile                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.certfile               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.collect_timing         = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.connect_retries        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.connect_retry_delay    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.default_floating_pool  = public {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.endpoint_override      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.extension_sync_interval = 600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.http_retries           = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.insecure               = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.keyfile                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.max_version            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.min_version            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.ovs_bridge             = br-int {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.physnets               = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.region_name            = RegionOne {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.service_metadata_proxy = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.service_name           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.service_type           = network {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.split_loggers          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.status_code_retries    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.status_code_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.timeout                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] neutron.version                = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] notifications.bdms_in_notifications = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] notifications.default_level    = INFO {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] notifications.notification_format = unversioned {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] notifications.notify_on_state_change = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] pci.alias                      = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] pci.device_spec                = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] pci.report_in_placement        = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.auth_section         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.auth_type            = password {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.cafile               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.certfile             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.collect_timing       = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.connect_retries      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.connect_retry_delay  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.default_domain_id    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.default_domain_name  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.domain_id            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.domain_name          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.endpoint_override    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.insecure             = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.keyfile              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.max_version          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.min_version          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.password             = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.project_domain_id    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.project_domain_name  = Default {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.project_id           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.project_name         = service {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.region_name          = RegionOne {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.service_name         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.service_type         = placement {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.split_loggers        = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.status_code_retries  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.status_code_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.system_scope         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.timeout              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.trust_id             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.user_domain_id       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.user_domain_name     = Default {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.user_id              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.username             = placement {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] placement.version              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.cores                    = 20 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.count_usage_from_placement = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.injected_file_content_bytes = 10240 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.injected_file_path_length = 255 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.injected_files           = 5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.instances                = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.key_pairs                = 100 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.metadata_items           = 128 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.ram                      = 51200 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.recheck_quota            = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.server_group_members     = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] quota.server_groups            = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rdp.enabled                    = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.image_metadata_prefilter = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.max_attempts         = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.max_placement_results = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] scheduler.workers              = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.host_subset_size = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.isolated_hosts = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.isolated_images = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.pci_in_placement = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.track_instance_changes = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] metrics.required               = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] metrics.weight_multiplier      = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] metrics.weight_setting         = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] serial_console.enabled         = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] serial_console.port_range      = 10000:20000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] serial_console.serialproxy_port = 6083 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.auth_section      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.auth_type         = password {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.cafile            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.certfile          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.collect_timing    = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.insecure          = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.keyfile           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.send_service_user_token = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.split_loggers     = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] service_user.timeout           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.agent_enabled            = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.enabled                  = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.html5proxy_port          = 6082 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.image_compression        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.jpeg_compression         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.playback_compression     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.server_listen            = 127.0.0.1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.streaming_mode           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] spice.zlib_compression         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] upgrade_levels.baseapi         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] upgrade_levels.cert            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] upgrade_levels.compute         = auto {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] upgrade_levels.conductor       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] upgrade_levels.scheduler       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.cafile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.certfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.insecure = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vendordata_dynamic_auth.timeout = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.api_retry_count         = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.ca_file                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.cache_prefix            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.cluster_name            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.connection_pool_size    = 10 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.console_delay_seconds   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.datastore_regex         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.host_ip                 = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.host_password           = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.host_port               = 443 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.host_username           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.insecure                = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.integration_bridge      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.maximum_objects         = 100 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.pbm_default_policy      = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.pbm_enabled             = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.pbm_wsdl_location       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.serial_port_proxy_uri   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.serial_port_service_uri = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.task_poll_interval      = 0.5 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.use_linked_clone        = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.vnc_keymap              = en-us {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.vnc_port                = 5900 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vmware.vnc_port_total          = 10000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.auth_schemes               = ['none'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.enabled                    = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.novncproxy_port            = 6080 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.vencrypt_ca_certs          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.vencrypt_client_cert       = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vnc.vencrypt_client_key        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.disable_rootwrap   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.enable_numa_live_migration = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.libvirt_disable_apic = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.client_socket_timeout     = 900 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.default_pool_size         = 1000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.keep_alive                = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.max_header_line           = 16384 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.ssl_ca_file               = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.ssl_cert_file             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.ssl_key_file              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.tcp_keepidle              = 600 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] zvm.ca_file                    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] zvm.cloud_connector_url        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] zvm.reachable_timeout          = 300 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.enforce_new_defaults = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.enforce_scope      = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.policy_default_rule = default {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.connection_string     = messaging:// {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.enabled               = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.es_doc_type           = notification {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.es_scroll_size        = 10000 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.es_scroll_time        = 2m {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.filter_error_trace    = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.hmac_keys             = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.sentinel_service_name = mymaster {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.socket_timeout        = 0.1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.trace_requests        = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler.trace_sqlalchemy      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler_jaeger.process_tags   = {} {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler_jaeger.service_name_prefix = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] profiler_otlp.service_name_prefix = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] remote_debug.host              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] remote_debug.port              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_notifications.retry = -1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.auth_section        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.auth_type           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.cafile              = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.certfile            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.collect_timing      = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.connect_retries     = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.connect_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.endpoint_id         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.endpoint_override   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.insecure            = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.keyfile             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.max_version         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.min_version         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.region_name         = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.service_name        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.service_type        = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.split_loggers       = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.status_code_retries = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.status_code_retry_delay = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.timeout             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.valid_interfaces    = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_limit.version             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_reports.file_event_handler = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] oslo_reports.log_dir           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_ovs_privileged.group  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] vif_plug_ovs_privileged.user   = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_ovs.isolate_vif         = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] os_brick.lock_path             = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] privsep_osbrick.capabilities   = [21] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] privsep_osbrick.group          = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] privsep_osbrick.helper_command = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] privsep_osbrick.user           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] nova_sys_admin.group           = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] nova_sys_admin.helper_command  = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] nova_sys_admin.user            = None {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG oslo_service.service [None req-6edbbad0-9ad0-47cd-b543-fad0f0a963a3 None None] ******************************************************************************** {{(pid=72904) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 27 04:54:13 user nova-compute[72904]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 27 04:54:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Starting native event thread {{(pid=72904) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Starting green dispatch thread {{(pid=72904) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Starting connection event dispatch thread {{(pid=72904) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Connecting to libvirt: qemu:///system {{(pid=72904) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9194bea800> {{(pid=72904) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 27 04:54:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9194bea800> {{(pid=72904) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 27 04:54:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Connection event '1' reason 'None'
Aug 27 04:54:13 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 04:54:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.mount [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Initialising _HostMountState generation 0 {{(pid=72904) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 27 04:54:20 user nova-compute[72904]: INFO nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host capabilities <capabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <host>
Aug 27 04:54:20 user nova-compute[72904]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 27 04:54:20 user nova-compute[72904]:     <cpu>
Aug 27 04:54:20 user nova-compute[72904]:       <arch>x86_64</arch>
Aug 27 04:54:20 user nova-compute[72904]:       <model>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <microcode version='1070'/>
Aug 27 04:54:20 user nova-compute[72904]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 27 04:54:20 user nova-compute[72904]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='osxsave'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='invtsc'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='rsba'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature name='skip-l1dfl-vmentry'/>
Aug 27 04:54:20 user nova-compute[72904]:       <pages unit='KiB' size='4'/>
Aug 27 04:54:20 user nova-compute[72904]:       <pages unit='KiB' size='2048'/>
Aug 27 04:54:20 user nova-compute[72904]:     </cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <power_management>
Aug 27 04:54:20 user nova-compute[72904]:       <suspend_mem/>
Aug 27 04:54:20 user nova-compute[72904]:       <suspend_disk/>
Aug 27 04:54:20 user nova-compute[72904]:       <suspend_hybrid/>
Aug 27 04:54:20 user nova-compute[72904]:     </power_management>
Aug 27 04:54:20 user nova-compute[72904]:     <iommu support='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <migration_features>
Aug 27 04:54:20 user nova-compute[72904]:       <live/>
Aug 27 04:54:20 user nova-compute[72904]:       <uri_transports>
Aug 27 04:54:20 user nova-compute[72904]:         <uri_transport>tcp</uri_transport>
Aug 27 04:54:20 user nova-compute[72904]:         <uri_transport>rdma</uri_transport>
Aug 27 04:54:20 user nova-compute[72904]:       </uri_transports>
Aug 27 04:54:20 user nova-compute[72904]:     </migration_features>
Aug 27 04:54:20 user nova-compute[72904]:     <topology>
Aug 27 04:54:20 user nova-compute[72904]:       <cells num='2'>
Aug 27 04:54:20 user nova-compute[72904]:         <cell id='0'>
Aug 27 04:54:20 user nova-compute[72904]:           <memory unit='KiB'>8189224</memory>
Aug 27 04:54:20 user nova-compute[72904]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 27 04:54:20 user nova-compute[72904]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 04:54:20 user nova-compute[72904]:           <distances>
Aug 27 04:54:20 user nova-compute[72904]:             <sibling id='0' value='10'/>
Aug 27 04:54:20 user nova-compute[72904]:             <sibling id='1' value='20'/>
Aug 27 04:54:20 user nova-compute[72904]:           </distances>
Aug 27 04:54:20 user nova-compute[72904]:           <cpus num='6'>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 27 04:54:20 user nova-compute[72904]:           </cpus>
Aug 27 04:54:20 user nova-compute[72904]:         </cell>
Aug 27 04:54:20 user nova-compute[72904]:         <cell id='1'>
Aug 27 04:54:20 user nova-compute[72904]:           <memory unit='KiB'>8206460</memory>
Aug 27 04:54:20 user nova-compute[72904]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 27 04:54:20 user nova-compute[72904]:           <pages unit='KiB' size='2048'>0</pages>
Aug 27 04:54:20 user nova-compute[72904]:           <distances>
Aug 27 04:54:20 user nova-compute[72904]:             <sibling id='0' value='20'/>
Aug 27 04:54:20 user nova-compute[72904]:             <sibling id='1' value='10'/>
Aug 27 04:54:20 user nova-compute[72904]:           </distances>
Aug 27 04:54:20 user nova-compute[72904]:           <cpus num='6'>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 27 04:54:20 user nova-compute[72904]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 27 04:54:20 user nova-compute[72904]:           </cpus>
Aug 27 04:54:20 user nova-compute[72904]:         </cell>
Aug 27 04:54:20 user nova-compute[72904]:       </cells>
Aug 27 04:54:20 user nova-compute[72904]:     </topology>
Aug 27 04:54:20 user nova-compute[72904]:     <cache>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 27 04:54:20 user nova-compute[72904]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 27 04:54:20 user nova-compute[72904]:     </cache>
Aug 27 04:54:20 user nova-compute[72904]:     <secmodel>
Aug 27 04:54:20 user nova-compute[72904]:       <model>apparmor</model>
Aug 27 04:54:20 user nova-compute[72904]:       <doi>0</doi>
Aug 27 04:54:20 user nova-compute[72904]:     </secmodel>
Aug 27 04:54:20 user nova-compute[72904]:     <secmodel>
Aug 27 04:54:20 user nova-compute[72904]:       <model>dac</model>
Aug 27 04:54:20 user nova-compute[72904]:       <doi>0</doi>
Aug 27 04:54:20 user nova-compute[72904]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 27 04:54:20 user nova-compute[72904]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 27 04:54:20 user nova-compute[72904]:     </secmodel>
Aug 27 04:54:20 user nova-compute[72904]:   </host>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='alpha'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>clipper</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='armv6l'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>spitz</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>nuri</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>kzm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sx1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>z2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>tosa</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>n810</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>n800</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>terrier</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>midway</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>microbit</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>verdex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>highbank</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>akita</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>connex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>collie</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='armv7l'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>spitz</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>nuri</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>kzm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sx1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>z2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>tosa</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>n810</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>n800</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>terrier</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>midway</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>microbit</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>verdex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>highbank</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>akita</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>connex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>collie</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='aarch64'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>integratorcp</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>borzoi</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>spitz</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>nuri</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>musca-b1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>versatileab</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>kzm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>musca-a</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>smdkc210</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sx1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>z2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>tosa</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>sabrelite</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>realview-eb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>n810</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>n800</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>versatilepb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>terrier</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mainstone</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>midway</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>musicpal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>microbit</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>cubieboard</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>verdex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>netduino2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>raspi3b</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>raspi2b</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>cheetah</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>highbank</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>akita</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>connex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>collie</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>raspi0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <acpi default='on' toggle='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='cris'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='i686'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>isapc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>microvm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='kvm'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <pae/>
Aug 27 04:54:20 user nova-compute[72904]:       <nonpae/>
Aug 27 04:54:20 user nova-compute[72904]:       <acpi default='on' toggle='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:       <apic default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='m68k'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>an5206</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>q800</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>next-cube</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='microblaze'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='microblazeel'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='mips'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='16'>malta</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='mipsel'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='16'>malta</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='mips64'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='16'>malta</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>pica61</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>magnum</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='mips64el'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='16'>malta</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mipssim</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>pica61</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>magnum</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='16'>boston</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='ppc'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mac99</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>40p</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>taihu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='ppc64'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>taihu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>40p</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mac99</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='ppc64le'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2048'>powernv9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>taihu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2048'>powernv10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>ppce500</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>40p</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>pegasos2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>bamboo</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>g3beige</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>mac99</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sam460ex</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>ref405ep</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2048'>powernv8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='riscv32'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='8'>spike</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>opentitan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='8'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='riscv64'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='8'>spike</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='5'>sifive_u</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>shakti_c</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sifive_e</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='8'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='s390x'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='sh4'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>shix</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>r2d</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='sh4eb'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>shix</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>r2d</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='sparc'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>SS-5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>SS-20</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>LX</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>SS-4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>SS-10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>Voyager</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='sparc64'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sun4u</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>niagara</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>sun4v</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='x86_64'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>64</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>x-remote</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='1'>isapc</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>microvm</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='kvm'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <acpi default='on' toggle='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:       <apic default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='xtensa'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>sim</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>kc705</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>ml605</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx200</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx60</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]:   <guest>
Aug 27 04:54:20 user nova-compute[72904]:     <os_type>hvm</os_type>
Aug 27 04:54:20 user nova-compute[72904]:     <arch name='xtensaeb'>
Aug 27 04:54:20 user nova-compute[72904]:       <wordsize>32</wordsize>
Aug 27 04:54:20 user nova-compute[72904]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='4'>sim</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>kc705</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>ml605</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>virt</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx200</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>lx60</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 27 04:54:20 user nova-compute[72904]:       <domain type='qemu'/>
Aug 27 04:54:20 user nova-compute[72904]:     </arch>
Aug 27 04:54:20 user nova-compute[72904]:     <features>
Aug 27 04:54:20 user nova-compute[72904]:       <cpuselection/>
Aug 27 04:54:20 user nova-compute[72904]:       <deviceboot/>
Aug 27 04:54:20 user nova-compute[72904]:       <disksnapshot default='on' toggle='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     </features>
Aug 27 04:54:20 user nova-compute[72904]:   </guest>
Aug 27 04:54:20 user nova-compute[72904]: </capabilities>
Aug 27 04:54:20 user nova-compute[72904]: 
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-i440fx-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>i686</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='255'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'/>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='lm'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ide</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-q35-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>i686</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='288'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'/>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='lm'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-q35-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>i686</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='288'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'/>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='lm'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-i386</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-i440fx-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>i686</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='255'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'/>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='lm'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ide</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-i440fx-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>x86_64</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='255'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>efi</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='invtsc'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='rsba'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ide</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-q35-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>x86_64</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='288'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>efi</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='invtsc'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='rsba'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-q35-jammy</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>x86_64</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='288'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>efi</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='invtsc'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='rsba'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 27 04:54:20 user nova-compute[72904]: <domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 27 04:54:20 user nova-compute[72904]:   <domain>kvm</domain>
Aug 27 04:54:20 user nova-compute[72904]:   <machine>pc-i440fx-6.2</machine>
Aug 27 04:54:20 user nova-compute[72904]:   <arch>x86_64</arch>
Aug 27 04:54:20 user nova-compute[72904]:   <vcpu max='255'/>
Aug 27 04:54:20 user nova-compute[72904]:   <iothreads supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:   <os supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='firmware'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>efi</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:     <loader supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>rom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pflash</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='readonly'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>yes</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='secure'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>no</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </loader>
Aug 27 04:54:20 user nova-compute[72904]:   </os>
Aug 27 04:54:20 user nova-compute[72904]:   <cpu>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-passthrough' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='hostPassthroughMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='maximum' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='maximumMigratable'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>on</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>off</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='host-model' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <vendor>Intel</vendor>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ss'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='vmx'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pcid'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='hypervisor'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arat'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='tsc_adjust'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='umip'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='md-clear'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='arch-capabilities'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='invtsc'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibpb'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='ibrs'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-stibp'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='amd-ssbd'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='rsba'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='require' name='pschange-mc-no'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='erms'/>
Aug 27 04:54:20 user nova-compute[72904]:       <feature policy='disable' name='xsaveopt'/>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:     <mode name='custom' supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>qemu64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>qemu32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>phenom</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>pentium</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>n270</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm64</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>kvm32</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>coreduo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>core2duo</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>athlon</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Westmere</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Snowridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Skylake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>SandyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Penryn</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G5</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G4</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G3</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Opteron_G2</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Opteron_G1</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>IvyBridge</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Icelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Haswell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Rome</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-Milan</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC-IBPB</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>EPYC</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Dhyana</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cooperlake</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>Conroe</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Cascadelake-Server</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-noTSX</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell-IBRS</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='no'>Broadwell</model>
Aug 27 04:54:20 user nova-compute[72904]:       <model usable='yes'>486</model>
Aug 27 04:54:20 user nova-compute[72904]:     </mode>
Aug 27 04:54:20 user nova-compute[72904]:   </cpu>
Aug 27 04:54:20 user nova-compute[72904]:   <memoryBacking supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:     <enum name='sourceType'>
Aug 27 04:54:20 user nova-compute[72904]:       <value>file</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>anonymous</value>
Aug 27 04:54:20 user nova-compute[72904]:       <value>memfd</value>
Aug 27 04:54:20 user nova-compute[72904]:     </enum>
Aug 27 04:54:20 user nova-compute[72904]:   </memoryBacking>
Aug 27 04:54:20 user nova-compute[72904]:   <devices>
Aug 27 04:54:20 user nova-compute[72904]:     <disk supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='diskDevice'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>disk</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cdrom</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>floppy</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>lun</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='bus'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ide</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>fdc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sata</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </disk>
Aug 27 04:54:20 user nova-compute[72904]:     <graphics supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='type'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>sdl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vnc</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>spice</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egl-headless</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </graphics>
Aug 27 04:54:20 user nova-compute[72904]:     <video supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='modelType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>cirrus</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>vmvga</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>qxl</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>none</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>bochs</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>ramfb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </video>
Aug 27 04:54:20 user nova-compute[72904]:     <hostdev supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='mode'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>subsystem</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='startupPolicy'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>default</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>mandatory</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>requisite</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>optional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='subsysType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>usb</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>pci</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>scsi</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='capsType'/>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='pciBackend'/>
Aug 27 04:54:20 user nova-compute[72904]:     </hostdev>
Aug 27 04:54:20 user nova-compute[72904]:     <rng supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtio-non-transitional</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>random</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>egd</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>builtin</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </rng>
Aug 27 04:54:20 user nova-compute[72904]:     <filesystem supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='driverType'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>path</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>handle</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>virtiofs</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </filesystem>
Aug 27 04:54:20 user nova-compute[72904]:     <tpm supported='yes'>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='model'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-tis</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>tpm-crb</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:       <enum name='backendModel'>
Aug 27 04:54:20 user nova-compute[72904]:         <value>passthrough</value>
Aug 27 04:54:20 user nova-compute[72904]:         <value>emulator</value>
Aug 27 04:54:20 user nova-compute[72904]:       </enum>
Aug 27 04:54:20 user nova-compute[72904]:     </tpm>
Aug 27 04:54:20 user nova-compute[72904]:   </devices>
Aug 27 04:54:20 user nova-compute[72904]:   <features>
Aug 27 04:54:20 user nova-compute[72904]:     <gic supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:     <vmcoreinfo supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <genid supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backingStoreInput supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <backup supported='yes'/>
Aug 27 04:54:20 user nova-compute[72904]:     <sev supported='no'/>
Aug 27 04:54:20 user nova-compute[72904]:   </features>
Aug 27 04:54:20 user nova-compute[72904]: </domainCapabilities>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72904) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72904) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Checking secure boot support for host arch (x86_64) {{(pid=72904) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Checking secure boot support for host arch (x86_64) {{(pid=72904) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Checking secure boot support for host arch (x86_64) {{(pid=72904) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 27 04:54:20 user nova-compute[72904]: INFO nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Secure Boot support detected
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] cpu compare xml: <cpu match="exact">
Aug 27 04:54:20 user nova-compute[72904]:   <model>Nehalem</model>
Aug 27 04:54:20 user nova-compute[72904]: </cpu>
Aug 27 04:54:20 user nova-compute[72904]:  {{(pid=72904) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 27 04:54:20 user nova-compute[72904]: INFO nova.virt.node [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Generated node identity 5171e224-87c1-41ec-9fd6-f1643cc7adc6
Aug 27 04:54:20 user nova-compute[72904]: INFO nova.virt.node [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Wrote node identity 5171e224-87c1-41ec-9fd6-f1643cc7adc6 to /opt/stack/data/nova/compute_id
Aug 27 04:54:20 user nova-compute[72904]: WARNING nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Compute nodes ['5171e224-87c1-41ec-9fd6-f1643cc7adc6'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 27 04:54:20 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 27 04:54:20 user nova-compute[72904]: WARNING nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 27 04:54:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:54:20 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:54:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:54:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Hypervisor/Node resource view: name=user free_ram=10849MB free_disk=26.462955474853516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:54:21 user nova-compute[72904]: WARNING nova.compute.resource_tracker [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] No compute node record for user:5171e224-87c1-41ec-9fd6-f1643cc7adc6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 5171e224-87c1-41ec-9fd6-f1643cc7adc6 could not be found.
Aug 27 04:54:21 user nova-compute[72904]: INFO nova.compute.resource_tracker [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Compute node record created for user:user with uuid: 5171e224-87c1-41ec-9fd6-f1643cc7adc6
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:54:21 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [req-b347ffa3-b456-41f6-a422-af331d794d16] Created resource provider record via placement API for resource provider with UUID 5171e224-87c1-41ec-9fd6-f1643cc7adc6 and name user.
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72904) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 27 04:54:21 user nova-compute[72904]: INFO nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] kernel doesn't support AMD SEV
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Libvirt baseline CPU <cpu>
Aug 27 04:54:21 user nova-compute[72904]:   <arch>x86_64</arch>
Aug 27 04:54:21 user nova-compute[72904]:   <model>Nehalem</model>
Aug 27 04:54:21 user nova-compute[72904]:   <vendor>Intel</vendor>
Aug 27 04:54:21 user nova-compute[72904]:   <topology sockets="6" cores="1" threads="1"/>
Aug 27 04:54:21 user nova-compute[72904]: </cpu>
Aug 27 04:54:21 user nova-compute[72904]:  {{(pid=72904) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Updated inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Updating resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 generation from 0 to 1 during operation: update_inventory {{(pid=72904) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Updating resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 generation from 1 to 2 during operation: update_traits {{(pid=72904) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.service [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Creating RPC server for service compute {{(pid=72904) start /opt/stack/nova/nova/service.py:182}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.service [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Join ServiceGroup membership for this service compute {{(pid=72904) start /opt/stack/nova/nova/service.py:199}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG nova.servicegroup.drivers.db [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72904) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:54:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:55:12 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:55:12 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:55:12 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=10205MB free_disk=26.366661071777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:55:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:55:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:55:13 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:55:13 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:55:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:55:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:56:13 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:56:13 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:56:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=10150MB free_disk=26.413131713867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:56:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:56:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:57:13 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:57:13 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:57:13 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=10134MB free_disk=26.196949005126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:57:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:57:14 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:57:14 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:57:14 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:57:14 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:57:14 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:57:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.094s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:57:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:57:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:14 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:58:15 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:15 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:15 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=9458MB free_disk=26.219985961914062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:58:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:58:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:58:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:58:19 user nova-compute[72904]: INFO nova.compute.claims [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Claim successful on node user
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:58:19 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:58:19 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Creating image(s)
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "/opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "/opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "/opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:20 user nova-compute[72904]: DEBUG nova.policy [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21e26f0938734629ac95abace6d0035d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cd8319024834ebb869d5123bf29f6e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:58:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.part --force-share --output=json" returned: 0 in 0.168s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:20 user nova-compute[72904]: DEBUG nova.virt.images [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] 946923b5-2c8b-4abd-9b8c-c0df6f5e9219 was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 04:58:20 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 04:58:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.part /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.part /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.converted" returned: 0 in 0.324s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.711s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:21 user nova-compute[72904]: INFO oslo.privsep.daemon [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpo_r0ly9i/privsep.sock']
Aug 27 04:58:21 user sudo[82348]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpo_r0ly9i/privsep.sock
Aug 27 04:58:21 user sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 04:58:23 user sudo[82348]: pam_unix(sudo:session): session closed for user root
Aug 27 04:58:23 user nova-compute[72904]: INFO oslo.privsep.daemon [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Spawned new privsep daemon via rootwrap
Aug 27 04:58:23 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 04:58:23 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 04:58:23 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 27 04:58:23 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82351
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.151s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk 1073741824" returned: 0 in 0.057s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.159s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Cannot resize image /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Ensure instance console log exists: /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:24 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Successfully created port: 9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:58:28 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Successfully updated port: 9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:58:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquired lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:28 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:58:28 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:58:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received event network-changed-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:58:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Refreshing instance network info cache due to event network-changed-9fb311a0-3c71-4174-9b3e-cf768cd5aa89. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:58:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] Acquiring lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:58:30 user nova-compute[72904]: INFO nova.compute.claims [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Claim successful on node user
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updating instance_info_cache with network_info: [{"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Releasing lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Instance network_info: |[{"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] Acquired lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Refreshing network info cache for port 9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Start _get_guest_xml network_info=[{"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:58:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1562583159',display_name='tempest-DeleteServersTestJSON-server-1562583159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1562583159',id=1,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cd8319024834ebb869d5123bf29f6e7',ramdisk_id='',reservation_id='r-afye7y5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1381558065',owner_user_name='tempest-DeleteServersTestJSON-1381558065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:20Z,user_data=None,user_id='21e26f0938734629ac95abace6d0035d',uuid=0324de51-3864-4a3b-bc2c-2046a9925275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Converting VIF {"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1b:9c,bridge_name='br-int',has_traffic_filtering=True,id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89,network=Network(97aa35d9-2849-4f12-99d8-0b6603879c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb311a0-3c') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lazy-loading 'pci_devices' on Instance uuid 0324de51-3864-4a3b-bc2c-2046a9925275 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:58:30 user nova-compute[72904]:   <uuid>0324de51-3864-4a3b-bc2c-2046a9925275</uuid>
Aug 27 04:58:30 user nova-compute[72904]:   <name>instance-00000001</name>
Aug 27 04:58:30 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:58:30 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:58:30 user nova-compute[72904]:   <metadata>
Aug 27 04:58:30 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:58:30 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:58:30 user nova-compute[72904]:       <nova:name>tempest-DeleteServersTestJSON-server-1562583159</nova:name>
Aug 27 04:58:30 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:58:30</nova:creationTime>
Aug 27 04:58:30 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:58:30 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:58:30 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:58:30 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:58:30 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:58:30 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:58:30 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:58:30 user nova-compute[72904]:       <nova:owner>
Aug 27 04:58:30 user nova-compute[72904]:         <nova:user uuid="21e26f0938734629ac95abace6d0035d">tempest-DeleteServersTestJSON-1381558065-project-member</nova:user>
Aug 27 04:58:30 user nova-compute[72904]:         <nova:project uuid="1cd8319024834ebb869d5123bf29f6e7">tempest-DeleteServersTestJSON-1381558065</nova:project>
Aug 27 04:58:30 user nova-compute[72904]:       </nova:owner>
Aug 27 04:58:30 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:58:30 user nova-compute[72904]:       <nova:ports>
Aug 27 04:58:30 user nova-compute[72904]:         <nova:port uuid="9fb311a0-3c71-4174-9b3e-cf768cd5aa89">
Aug 27 04:58:30 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 04:58:30 user nova-compute[72904]:         </nova:port>
Aug 27 04:58:30 user nova-compute[72904]:       </nova:ports>
Aug 27 04:58:30 user nova-compute[72904]:     </nova:instance>
Aug 27 04:58:30 user nova-compute[72904]:   </metadata>
Aug 27 04:58:30 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:58:30 user nova-compute[72904]:     <system>
Aug 27 04:58:30 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:58:30 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:58:30 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:58:30 user nova-compute[72904]:       <entry name="serial">0324de51-3864-4a3b-bc2c-2046a9925275</entry>
Aug 27 04:58:30 user nova-compute[72904]:       <entry name="uuid">0324de51-3864-4a3b-bc2c-2046a9925275</entry>
Aug 27 04:58:30 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:58:30 user nova-compute[72904]:     </system>
Aug 27 04:58:30 user nova-compute[72904]:   </sysinfo>
Aug 27 04:58:30 user nova-compute[72904]:   <os>
Aug 27 04:58:30 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:58:30 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:58:30 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:58:30 user nova-compute[72904]:   </os>
Aug 27 04:58:30 user nova-compute[72904]:   <features>
Aug 27 04:58:30 user nova-compute[72904]:     <acpi/>
Aug 27 04:58:30 user nova-compute[72904]:     <apic/>
Aug 27 04:58:30 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:58:30 user nova-compute[72904]:   </features>
Aug 27 04:58:30 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:58:30 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:58:30 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:58:30 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:58:30 user nova-compute[72904]:   </clock>
Aug 27 04:58:30 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:58:30 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:58:30 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:58:30 user nova-compute[72904]:   </cpu>
Aug 27 04:58:30 user nova-compute[72904]:   <devices>
Aug 27 04:58:30 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:58:30 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:58:30 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk"/>
Aug 27 04:58:30 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:58:30 user nova-compute[72904]:     </disk>
Aug 27 04:58:30 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:58:30 user nova-compute[72904]:       <mac address="fa:16:3e:9c:1b:9c"/>
Aug 27 04:58:30 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:30 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:58:30 user nova-compute[72904]:       <target dev="tap9fb311a0-3c"/>
Aug 27 04:58:30 user nova-compute[72904]:     </interface>
Aug 27 04:58:30 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:58:30 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/console.log" append="off"/>
Aug 27 04:58:30 user nova-compute[72904]:     </serial>
Aug 27 04:58:30 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:58:30 user nova-compute[72904]:     <video>
Aug 27 04:58:30 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:30 user nova-compute[72904]:     </video>
Aug 27 04:58:30 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:58:30 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:58:30 user nova-compute[72904]:     </rng>
Aug 27 04:58:30 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:58:30 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:58:30 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:58:30 user nova-compute[72904]:     </memballoon>
Aug 27 04:58:30 user nova-compute[72904]:   </devices>
Aug 27 04:58:30 user nova-compute[72904]: </domain>
Aug 27 04:58:30 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1562583159',display_name='tempest-DeleteServersTestJSON-server-1562583159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1562583159',id=1,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cd8319024834ebb869d5123bf29f6e7',ramdisk_id='',reservation_id='r-afye7y5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1381558065',owner_user_name='tempest-DeleteServersTestJSON-1381558065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:20Z,user_data=None,user_id='21e26f0938734629ac95abace6d0035d',uuid=0324de51-3864-4a3b-bc2c-2046a9925275,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Converting VIF {"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1b:9c,bridge_name='br-int',has_traffic_filtering=True,id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89,network=Network(97aa35d9-2849-4f12-99d8-0b6603879c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb311a0-3c') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG os_vif [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1b:9c,bridge_name='br-int',has_traffic_filtering=True,id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89,network=Network(97aa35d9-2849-4f12-99d8-0b6603879c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb311a0-3c') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Created schema index Interface.name {{(pid=72904) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Created schema index Port.name {{(pid=72904) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Created schema index Bridge.name {{(pid=72904) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [POLLOUT] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.network.neutron [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:30 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:58:30 user nova-compute[72904]: INFO oslo.privsep.daemon [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmposani167/privsep.sock']
Aug 27 04:58:30 user sudo[82390]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmposani167/privsep.sock
Aug 27 04:58:30 user sudo[82390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 04:58:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:58:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Creating image(s)
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "/opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "/opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk 1073741824" returned: 0 in 0.068s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG nova.policy [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcd62b49154b47d58be14586316fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c2163be4446719e85d97984980e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Cannot resize image /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Ensure instance console log exists: /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:32 user sudo[82390]: pam_unix(sudo:session): session closed for user root
Aug 27 04:58:32 user nova-compute[72904]: INFO oslo.privsep.daemon [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Spawned new privsep daemon via rootwrap
Aug 27 04:58:32 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 04:58:32 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 04:58:32 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 27 04:58:32 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82472
Aug 27 04:58:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fb311a0-3c, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9fb311a0-3c, col_values=(('external_ids', {'iface-id': '9fb311a0-3c71-4174-9b3e-cf768cd5aa89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:1b:9c', 'vm-uuid': '0324de51-3864-4a3b-bc2c-2046a9925275'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:33 user nova-compute[72904]: INFO os_vif [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:1b:9c,bridge_name='br-int',has_traffic_filtering=True,id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89,network=Network(97aa35d9-2849-4f12-99d8-0b6603879c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb311a0-3c')
Aug 27 04:58:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] No VIF found with MAC fa:16:3e:9c:1b:9c, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updated VIF entry in instance network info cache for port 9fb311a0-3c71-4174-9b3e-cf768cd5aa89. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updating instance_info_cache with network_info: [{"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fae09a19-ad08-46b1-bb37-ef5064dccac0 req-894bed2f-84c7-4f09-b705-f1acf8d36a35 service nova] Releasing lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:34 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:58:34 user nova-compute[72904]: INFO nova.compute.claims [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Claim successful on node user
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Successfully created port: d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:58:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:58:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Creating image(s)
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:58:35 user nova-compute[72904]: INFO nova.compute.claims [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Claim successful on node user
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk 1073741824" returned: 0 in 0.063s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.policy [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f916716b9147f28b371d499b31aff8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26df968c46154c42bd5889d09318bbe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.161s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112316.2708726, 0324de51-3864-4a3b-bc2c-2046a9925275 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] VM Resumed (Lifecycle Event)
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Instance spawned successfully.
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112316.2723963, 0324de51-3864-4a3b-bc2c-2046a9925275 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] VM Started (Lifecycle Event)
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Took 16.73 seconds to spawn the instance on the hypervisor.
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Cannot resize image /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Ensure instance console log exists: /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.compute.manager [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Took 17.53 seconds to build instance.
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a27b7cee-34be-4f9f-9dd5-98551fa674f6 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.761s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.policy [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58fce22ad00e47498c3cd80b3b6fe458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e36dfaf419f4b78820a3536c6f65ad5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:58:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Creating image(s)
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.218s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk 1073741824" returned: 0 in 0.056s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Cannot resize image /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Ensure instance console log exists: /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:38 user nova-compute[72904]: DEBUG nova.network.neutron [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Successfully created port: f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Successfully created port: 25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Successfully updated port: d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquired lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received event network-changed-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Refreshing instance network info cache due to event network-changed-d3d0e31c-9061-4e4e-8729-6726c8b32827. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:58:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] Acquiring lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:40 user nova-compute[72904]: DEBUG nova.network.neutron [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:58:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updating instance_info_cache with network_info: [{"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Releasing lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Instance network_info: |[{"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] Acquired lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.network.neutron [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Refreshing network info cache for port d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Start _get_guest_xml network_info=[{"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:58:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-806519351',display_name='tempest-ServersNegativeTestJSON-server-806519351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-806519351',id=2,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='639c2163be4446719e85d97984980e7f',ramdisk_id='',reservation_id='r-xt0i02tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1301649002',owner_user_name='tempest-ServersNegativeTestJSON-1301649002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:31Z,user_data=None,user_id='fcd62b49154b47d58be14586316fc1a3',uuid=9ca0a7be-bc37-473c-8523-4808a76a1b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converting VIF {"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a4:1d,bridge_name='br-int',has_traffic_filtering=True,id=d3d0e31c-9061-4e4e-8729-6726c8b32827,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d0e31c-90') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.objects.instance [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ca0a7be-bc37-473c-8523-4808a76a1b5d {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:58:41 user nova-compute[72904]:   <uuid>9ca0a7be-bc37-473c-8523-4808a76a1b5d</uuid>
Aug 27 04:58:41 user nova-compute[72904]:   <name>instance-00000002</name>
Aug 27 04:58:41 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:58:41 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:58:41 user nova-compute[72904]:   <metadata>
Aug 27 04:58:41 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:58:41 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:58:41 user nova-compute[72904]:       <nova:name>tempest-ServersNegativeTestJSON-server-806519351</nova:name>
Aug 27 04:58:41 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:58:41</nova:creationTime>
Aug 27 04:58:41 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:58:41 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:58:41 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:58:41 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:58:41 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:58:41 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:58:41 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:58:41 user nova-compute[72904]:       <nova:owner>
Aug 27 04:58:41 user nova-compute[72904]:         <nova:user uuid="fcd62b49154b47d58be14586316fc1a3">tempest-ServersNegativeTestJSON-1301649002-project-member</nova:user>
Aug 27 04:58:41 user nova-compute[72904]:         <nova:project uuid="639c2163be4446719e85d97984980e7f">tempest-ServersNegativeTestJSON-1301649002</nova:project>
Aug 27 04:58:41 user nova-compute[72904]:       </nova:owner>
Aug 27 04:58:41 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:58:41 user nova-compute[72904]:       <nova:ports>
Aug 27 04:58:41 user nova-compute[72904]:         <nova:port uuid="d3d0e31c-9061-4e4e-8729-6726c8b32827">
Aug 27 04:58:41 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 04:58:41 user nova-compute[72904]:         </nova:port>
Aug 27 04:58:41 user nova-compute[72904]:       </nova:ports>
Aug 27 04:58:41 user nova-compute[72904]:     </nova:instance>
Aug 27 04:58:41 user nova-compute[72904]:   </metadata>
Aug 27 04:58:41 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:58:41 user nova-compute[72904]:     <system>
Aug 27 04:58:41 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:58:41 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:58:41 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:58:41 user nova-compute[72904]:       <entry name="serial">9ca0a7be-bc37-473c-8523-4808a76a1b5d</entry>
Aug 27 04:58:41 user nova-compute[72904]:       <entry name="uuid">9ca0a7be-bc37-473c-8523-4808a76a1b5d</entry>
Aug 27 04:58:41 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:58:41 user nova-compute[72904]:     </system>
Aug 27 04:58:41 user nova-compute[72904]:   </sysinfo>
Aug 27 04:58:41 user nova-compute[72904]:   <os>
Aug 27 04:58:41 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:58:41 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:58:41 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:58:41 user nova-compute[72904]:   </os>
Aug 27 04:58:41 user nova-compute[72904]:   <features>
Aug 27 04:58:41 user nova-compute[72904]:     <acpi/>
Aug 27 04:58:41 user nova-compute[72904]:     <apic/>
Aug 27 04:58:41 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:58:41 user nova-compute[72904]:   </features>
Aug 27 04:58:41 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:58:41 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:58:41 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:58:41 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:58:41 user nova-compute[72904]:   </clock>
Aug 27 04:58:41 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:58:41 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:58:41 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:58:41 user nova-compute[72904]:   </cpu>
Aug 27 04:58:41 user nova-compute[72904]:   <devices>
Aug 27 04:58:41 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:58:41 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:58:41 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk"/>
Aug 27 04:58:41 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:58:41 user nova-compute[72904]:     </disk>
Aug 27 04:58:41 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:58:41 user nova-compute[72904]:       <mac address="fa:16:3e:a2:a4:1d"/>
Aug 27 04:58:41 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:41 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:58:41 user nova-compute[72904]:       <target dev="tapd3d0e31c-90"/>
Aug 27 04:58:41 user nova-compute[72904]:     </interface>
Aug 27 04:58:41 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:58:41 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/console.log" append="off"/>
Aug 27 04:58:41 user nova-compute[72904]:     </serial>
Aug 27 04:58:41 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:58:41 user nova-compute[72904]:     <video>
Aug 27 04:58:41 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:41 user nova-compute[72904]:     </video>
Aug 27 04:58:41 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:58:41 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:58:41 user nova-compute[72904]:     </rng>
Aug 27 04:58:41 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:58:41 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:58:41 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:58:41 user nova-compute[72904]:     </memballoon>
Aug 27 04:58:41 user nova-compute[72904]:   </devices>
Aug 27 04:58:41 user nova-compute[72904]: </domain>
Aug 27 04:58:41 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-806519351',display_name='tempest-ServersNegativeTestJSON-server-806519351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-806519351',id=2,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='639c2163be4446719e85d97984980e7f',ramdisk_id='',reservation_id='r-xt0i02tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1301649002',owner_user_name='tempest-ServersNegativeTestJSON-1301649002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:31Z,user_data=None,user_id='fcd62b49154b47d58be14586316fc1a3',uuid=9ca0a7be-bc37-473c-8523-4808a76a1b5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converting VIF {"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a4:1d,bridge_name='br-int',has_traffic_filtering=True,id=d3d0e31c-9061-4e4e-8729-6726c8b32827,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d0e31c-90') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG os_vif [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a4:1d,bridge_name='br-int',has_traffic_filtering=True,id=d3d0e31c-9061-4e4e-8729-6726c8b32827,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d0e31c-90') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3d0e31c-90, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3d0e31c-90, col_values=(('external_ids', {'iface-id': 'd3d0e31c-9061-4e4e-8729-6726c8b32827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:a4:1d', 'vm-uuid': '9ca0a7be-bc37-473c-8523-4808a76a1b5d'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: INFO os_vif [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a4:1d,bridge_name='br-int',has_traffic_filtering=True,id=d3d0e31c-9061-4e4e-8729-6726c8b32827,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d0e31c-90')
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] No VIF found with MAC fa:16:3e:a2:a4:1d, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Successfully updated port: 25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.network.neutron [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updated VIF entry in instance network info cache for port d3d0e31c-9061-4e4e-8729-6726c8b32827. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.network.neutron [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updating instance_info_cache with network_info: [{"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-12cd6a31-169e-45f1-b809-34c56f0c4606 req-a7e74a2c-b924-497c-8b3a-091d38268ddb service nova] Releasing lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing instance network info cache due to event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Successfully updated port: f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:58:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance network_info: |[{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Start _get_guest_xml network_info=[{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:58:43 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:43 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-changed-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Refreshing instance network info cache due to event network-changed-f4285663-09bc-421f-9017-4c18cf096612. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1516546030',display_name='tempest-ServerStableDeviceRescueTest-server-1516546030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1516546030',id=3,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXPJ3ICrlA/cmQIas/XcCpHwfVtvqbwe/pMXrS60OLOmiDcBvKM4sTK5i5N1RlrmPCuHF7isVXR3d9y/cD+PEQxszneeTg/yBdt9s6dYyPTX8VIAzpg+mXwOatTCMOmww==',key_name='tempest-keypair-509925292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26df968c46154c42bd5889d09318bbe2',ramdisk_id='',reservation_id='r-7xre0f4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-117364697',owner_user_name='tempest-ServerStableDeviceRescueTest-117364697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f916716b9147f28b371d499b31aff8',uuid=cae1202f-0f6c-437e-8334-215b4736e061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converting VIF {"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'pci_devices' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:58:43 user nova-compute[72904]:   <uuid>cae1202f-0f6c-437e-8334-215b4736e061</uuid>
Aug 27 04:58:43 user nova-compute[72904]:   <name>instance-00000003</name>
Aug 27 04:58:43 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:58:43 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:58:43 user nova-compute[72904]:   <metadata>
Aug 27 04:58:43 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:58:43 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:58:43 user nova-compute[72904]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1516546030</nova:name>
Aug 27 04:58:43 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:58:43</nova:creationTime>
Aug 27 04:58:43 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:58:43 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:58:43 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:58:43 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:58:43 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:58:43 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:58:43 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:58:43 user nova-compute[72904]:       <nova:owner>
Aug 27 04:58:43 user nova-compute[72904]:         <nova:user uuid="99f916716b9147f28b371d499b31aff8">tempest-ServerStableDeviceRescueTest-117364697-project-member</nova:user>
Aug 27 04:58:43 user nova-compute[72904]:         <nova:project uuid="26df968c46154c42bd5889d09318bbe2">tempest-ServerStableDeviceRescueTest-117364697</nova:project>
Aug 27 04:58:43 user nova-compute[72904]:       </nova:owner>
Aug 27 04:58:43 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:58:43 user nova-compute[72904]:       <nova:ports>
Aug 27 04:58:43 user nova-compute[72904]:         <nova:port uuid="25f639bd-e92f-45c8-be05-fe92c4ee4e39">
Aug 27 04:58:43 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 04:58:43 user nova-compute[72904]:         </nova:port>
Aug 27 04:58:43 user nova-compute[72904]:       </nova:ports>
Aug 27 04:58:43 user nova-compute[72904]:     </nova:instance>
Aug 27 04:58:43 user nova-compute[72904]:   </metadata>
Aug 27 04:58:43 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:58:43 user nova-compute[72904]:     <system>
Aug 27 04:58:43 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:58:43 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:58:43 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:58:43 user nova-compute[72904]:       <entry name="serial">cae1202f-0f6c-437e-8334-215b4736e061</entry>
Aug 27 04:58:43 user nova-compute[72904]:       <entry name="uuid">cae1202f-0f6c-437e-8334-215b4736e061</entry>
Aug 27 04:58:43 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:58:43 user nova-compute[72904]:     </system>
Aug 27 04:58:43 user nova-compute[72904]:   </sysinfo>
Aug 27 04:58:43 user nova-compute[72904]:   <os>
Aug 27 04:58:43 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:58:43 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:58:43 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:58:43 user nova-compute[72904]:   </os>
Aug 27 04:58:43 user nova-compute[72904]:   <features>
Aug 27 04:58:43 user nova-compute[72904]:     <acpi/>
Aug 27 04:58:43 user nova-compute[72904]:     <apic/>
Aug 27 04:58:43 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:58:43 user nova-compute[72904]:   </features>
Aug 27 04:58:43 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:58:43 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:58:43 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:58:43 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:58:43 user nova-compute[72904]:   </clock>
Aug 27 04:58:43 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:58:43 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:58:43 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:58:43 user nova-compute[72904]:   </cpu>
Aug 27 04:58:43 user nova-compute[72904]:   <devices>
Aug 27 04:58:43 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:58:43 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:58:43 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk"/>
Aug 27 04:58:43 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:58:43 user nova-compute[72904]:     </disk>
Aug 27 04:58:43 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:58:43 user nova-compute[72904]:       <mac address="fa:16:3e:ff:37:d6"/>
Aug 27 04:58:43 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:43 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:58:43 user nova-compute[72904]:       <target dev="tap25f639bd-e9"/>
Aug 27 04:58:43 user nova-compute[72904]:     </interface>
Aug 27 04:58:43 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:58:43 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/console.log" append="off"/>
Aug 27 04:58:43 user nova-compute[72904]:     </serial>
Aug 27 04:58:43 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:58:43 user nova-compute[72904]:     <video>
Aug 27 04:58:43 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:43 user nova-compute[72904]:     </video>
Aug 27 04:58:43 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:58:43 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:58:43 user nova-compute[72904]:     </rng>
Aug 27 04:58:43 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:58:43 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:58:43 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:58:43 user nova-compute[72904]:     </memballoon>
Aug 27 04:58:43 user nova-compute[72904]:   </devices>
Aug 27 04:58:43 user nova-compute[72904]: </domain>
Aug 27 04:58:43 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1516546030',display_name='tempest-ServerStableDeviceRescueTest-server-1516546030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1516546030',id=3,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXPJ3ICrlA/cmQIas/XcCpHwfVtvqbwe/pMXrS60OLOmiDcBvKM4sTK5i5N1RlrmPCuHF7isVXR3d9y/cD+PEQxszneeTg/yBdt9s6dYyPTX8VIAzpg+mXwOatTCMOmww==',key_name='tempest-keypair-509925292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26df968c46154c42bd5889d09318bbe2',ramdisk_id='',reservation_id='r-7xre0f4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-117364697',owner_user_name='tempest-ServerStableDeviceRescueTest-117364697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f916716b9147f28b371d499b31aff8',uuid=cae1202f-0f6c-437e-8334-215b4736e061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converting VIF {"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG os_vif [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25f639bd-e9, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap25f639bd-e9, col_values=(('external_ids', {'iface-id': '25f639bd-e92f-45c8-be05-fe92c4ee4e39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:37:d6', 'vm-uuid': 'cae1202f-0f6c-437e-8334-215b4736e061'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: INFO os_vif [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9')
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No VIF found with MAC fa:16:3e:ff:37:d6, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance network_info: |[{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.neutron [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Refreshing network info cache for port f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Start _get_guest_xml network_info=[{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:58:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.neutron [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updated VIF entry in instance network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.neutron [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.objects.instance [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lazy-loading 'pci_devices' on Instance uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2a630ddb-93d4-4c61-9a9c-fbea7c00321d req-b617836f-c9f4-4c79-ae85-b1763f1c34ac service nova] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:58:45 user nova-compute[72904]:   <uuid>d57daa0e-5ce0-47cb-90f1-c4327bca54a0</uuid>
Aug 27 04:58:45 user nova-compute[72904]:   <name>instance-00000004</name>
Aug 27 04:58:45 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:58:45 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:58:45 user nova-compute[72904]:   <metadata>
Aug 27 04:58:45 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:58:45 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:58:45 user nova-compute[72904]:       <nova:name>tempest-ServerActionsTestOtherB-server-1845492887</nova:name>
Aug 27 04:58:45 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:58:45</nova:creationTime>
Aug 27 04:58:45 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:58:45 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:58:45 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:58:45 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:58:45 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:58:45 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:58:45 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:58:45 user nova-compute[72904]:       <nova:owner>
Aug 27 04:58:45 user nova-compute[72904]:         <nova:user uuid="58fce22ad00e47498c3cd80b3b6fe458">tempest-ServerActionsTestOtherB-30211083-project-member</nova:user>
Aug 27 04:58:45 user nova-compute[72904]:         <nova:project uuid="3e36dfaf419f4b78820a3536c6f65ad5">tempest-ServerActionsTestOtherB-30211083</nova:project>
Aug 27 04:58:45 user nova-compute[72904]:       </nova:owner>
Aug 27 04:58:45 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:58:45 user nova-compute[72904]:       <nova:ports>
Aug 27 04:58:45 user nova-compute[72904]:         <nova:port uuid="f4285663-09bc-421f-9017-4c18cf096612">
Aug 27 04:58:45 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 04:58:45 user nova-compute[72904]:         </nova:port>
Aug 27 04:58:45 user nova-compute[72904]:       </nova:ports>
Aug 27 04:58:45 user nova-compute[72904]:     </nova:instance>
Aug 27 04:58:45 user nova-compute[72904]:   </metadata>
Aug 27 04:58:45 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:58:45 user nova-compute[72904]:     <system>
Aug 27 04:58:45 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:58:45 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:58:45 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:58:45 user nova-compute[72904]:       <entry name="serial">d57daa0e-5ce0-47cb-90f1-c4327bca54a0</entry>
Aug 27 04:58:45 user nova-compute[72904]:       <entry name="uuid">d57daa0e-5ce0-47cb-90f1-c4327bca54a0</entry>
Aug 27 04:58:45 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:58:45 user nova-compute[72904]:     </system>
Aug 27 04:58:45 user nova-compute[72904]:   </sysinfo>
Aug 27 04:58:45 user nova-compute[72904]:   <os>
Aug 27 04:58:45 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:58:45 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:58:45 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:58:45 user nova-compute[72904]:   </os>
Aug 27 04:58:45 user nova-compute[72904]:   <features>
Aug 27 04:58:45 user nova-compute[72904]:     <acpi/>
Aug 27 04:58:45 user nova-compute[72904]:     <apic/>
Aug 27 04:58:45 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:58:45 user nova-compute[72904]:   </features>
Aug 27 04:58:45 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:58:45 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:58:45 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:58:45 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:58:45 user nova-compute[72904]:   </clock>
Aug 27 04:58:45 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:58:45 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:58:45 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:58:45 user nova-compute[72904]:   </cpu>
Aug 27 04:58:45 user nova-compute[72904]:   <devices>
Aug 27 04:58:45 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:58:45 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:58:45 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk"/>
Aug 27 04:58:45 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:58:45 user nova-compute[72904]:     </disk>
Aug 27 04:58:45 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:58:45 user nova-compute[72904]:       <mac address="fa:16:3e:67:1b:45"/>
Aug 27 04:58:45 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:45 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:58:45 user nova-compute[72904]:       <target dev="tapf4285663-09"/>
Aug 27 04:58:45 user nova-compute[72904]:     </interface>
Aug 27 04:58:45 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:58:45 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/console.log" append="off"/>
Aug 27 04:58:45 user nova-compute[72904]:     </serial>
Aug 27 04:58:45 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:58:45 user nova-compute[72904]:     <video>
Aug 27 04:58:45 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:58:45 user nova-compute[72904]:     </video>
Aug 27 04:58:45 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:58:45 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:58:45 user nova-compute[72904]:     </rng>
Aug 27 04:58:45 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:58:45 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:58:45 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:58:45 user nova-compute[72904]:     </memballoon>
Aug 27 04:58:45 user nova-compute[72904]:   </devices>
Aug 27 04:58:45 user nova-compute[72904]: </domain>
Aug 27 04:58:45 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG os_vif [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4285663-09, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4285663-09, col_values=(('external_ids', {'iface-id': 'f4285663-09bc-421f-9017-4c18cf096612', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:1b:45', 'vm-uuid': 'd57daa0e-5ce0-47cb-90f1-c4327bca54a0'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: INFO os_vif [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09')
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No VIF found with MAC fa:16:3e:67:1b:45, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112325.9526315, 9ca0a7be-bc37-473c-8523-4808a76a1b5d => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:45 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] VM Resumed (Lifecycle Event)
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:58:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:46 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Instance spawned successfully.
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:46 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112325.9684474, 9ca0a7be-bc37-473c-8523-4808a76a1b5d => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:46 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] VM Started (Lifecycle Event)
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:46 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:58:46 user nova-compute[72904]: INFO nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Took 15.08 seconds to spawn the instance on the hypervisor.
Aug 27 04:58:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:46 user nova-compute[72904]: INFO nova.compute.manager [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Took 16.03 seconds to build instance.
Aug 27 04:58:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d86a685-0c17-422f-8152-655bd9549a93 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.189s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updated VIF entry in instance network info cache for port f4285663-09bc-421f-9017-4c18cf096612. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:58:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:58:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7336a18e-8ff0-4f6a-9619-7812d5330f65 req-59e940bc-0712-47c0-97dc-4a07946c8cae service nova] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:58:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-2a77ac32-e382-4cb2-ae83-c074e15eedac req-84404ac6-deaa-4840-b26e-7b6510b35ad2 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:58:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2a77ac32-e382-4cb2-ae83-c074e15eedac req-84404ac6-deaa-4840-b26e-7b6510b35ad2 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2a77ac32-e382-4cb2-ae83-c074e15eedac req-84404ac6-deaa-4840-b26e-7b6510b35ad2 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2a77ac32-e382-4cb2-ae83-c074e15eedac req-84404ac6-deaa-4840-b26e-7b6510b35ad2 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-2a77ac32-e382-4cb2-ae83-c074e15eedac req-84404ac6-deaa-4840-b26e-7b6510b35ad2 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:58:48 user nova-compute[72904]: WARNING nova.compute.manager [req-2a77ac32-e382-4cb2-ae83-c074e15eedac req-84404ac6-deaa-4840-b26e-7b6510b35ad2 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state building and task_state spawning.
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112329.5680954, cae1202f-0f6c-437e-8334-215b4736e061 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] VM Resumed (Lifecycle Event)
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:58:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance spawned successfully.
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112329.574376, cae1202f-0f6c-437e-8334-215b4736e061 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] VM Started (Lifecycle Event)
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:58:49 user nova-compute[72904]: INFO nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Took 14.15 seconds to spawn the instance on the hypervisor.
Aug 27 04:58:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:49 user nova-compute[72904]: INFO nova.compute.manager [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Took 15.05 seconds to build instance.
Aug 27 04:58:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e429adbc-a486-4a92-ab67-c94cdc01c56f tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.363s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-73ab0912-6ab9-47e2-b3d3-b3ba7e61414a req-61e4a7de-7fdc-4d17-9cce-ac8621368747 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-73ab0912-6ab9-47e2-b3d3-b3ba7e61414a req-61e4a7de-7fdc-4d17-9cce-ac8621368747 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-73ab0912-6ab9-47e2-b3d3-b3ba7e61414a req-61e4a7de-7fdc-4d17-9cce-ac8621368747 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-73ab0912-6ab9-47e2-b3d3-b3ba7e61414a req-61e4a7de-7fdc-4d17-9cce-ac8621368747 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-73ab0912-6ab9-47e2-b3d3-b3ba7e61414a req-61e4a7de-7fdc-4d17-9cce-ac8621368747 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:58:50 user nova-compute[72904]: WARNING nova.compute.manager [req-73ab0912-6ab9-47e2-b3d3-b3ba7e61414a req-61e4a7de-7fdc-4d17-9cce-ac8621368747 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state active and task_state None.
Aug 27 04:58:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112330.2228742, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:50 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Resumed (Lifecycle Event)
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:58:50 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance spawned successfully.
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:58:50 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112330.2296028, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:58:50 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Started (Lifecycle Event)
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:58:50 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:58:50 user nova-compute[72904]: INFO nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Took 13.70 seconds to spawn the instance on the hypervisor.
Aug 27 04:58:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:50 user nova-compute[72904]: INFO nova.compute.manager [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Took 14.68 seconds to build instance.
Aug 27 04:58:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-548a3951-6bd8-4d4e-8445-39792f60111f tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.936s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:58:58 user nova-compute[72904]: INFO nova.compute.claims [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Claim successful on node user
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:58:58 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:58:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG nova.policy [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '009cdc58f61f4837ab8d4ee79d8b2a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d39e559d3e346078cd876c7f09913eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:58:59 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Creating image(s)
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "/opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "/opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "/opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.253s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.236s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk 1073741824" returned: 0 in 0.084s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:58:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Successfully created port: 6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.274s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:59:00 user nova-compute[72904]: INFO nova.compute.claims [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Claim successful on node user
Aug 27 04:59:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Cannot resize image /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Ensure instance console log exists: /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Successfully updated port: 6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquired lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:59:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-changed-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Refreshing instance network info cache due to event network-changed-6031cf82-e9e2-4c84-bac3-27d01d92c0fc. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] Acquiring lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:59:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Creating image(s)
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "/opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "/opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "/opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.policy [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aa245527faf42099b0bcefbad8e9a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d22ddf3716486784e9bc8d39420d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.289s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.214s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk 1073741824" returned: 0 in 0.067s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:59:01 user nova-compute[72904]: INFO nova.compute.claims [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Claim successful on node user
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.235s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updating instance_info_cache with network_info: [{"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Releasing lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Instance network_info: |[{"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] Acquired lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.neutron [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Refreshing network info cache for port 6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Start _get_guest_xml network_info=[{"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:59:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2035711756',display_name='tempest-TestVolumeSwap-server-2035711756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2035711756',id=5,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG5tbNsTozwwOnECGSs75JugxZ7RFsybYiUzavaqNwtsph4/BrBgkRw4vTKnUd+27e2W89Qpvrg1c0PErbqulh4VKfZS/KS2/KW3hhzHsRZk97at26jd1ojPO0rZjlUhw==',key_name='tempest-keypair-1212211526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d39e559d3e346078cd876c7f09913eb',ramdisk_id='',reservation_id='r-byk0xos9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1120456123',owner_user_name='tempest-TestVolumeSwap-1120456123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='009cdc58f61f4837ab8d4ee79d8b2a5d',uuid=3853715e-fce2-4c7c-b2a1-b8875866e0e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Converting VIF {"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c5:91,bridge_name='br-int',has_traffic_filtering=True,id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc,network=Network(bde7ad3f-f2d3-4565-b777-00d2c70feddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6031cf82-e9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lazy-loading 'pci_devices' on Instance uuid 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Successfully created port: 99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:59:02 user nova-compute[72904]:   <uuid>3853715e-fce2-4c7c-b2a1-b8875866e0e8</uuid>
Aug 27 04:59:02 user nova-compute[72904]:   <name>instance-00000005</name>
Aug 27 04:59:02 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:59:02 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:59:02 user nova-compute[72904]:   <metadata>
Aug 27 04:59:02 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:59:02 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:59:02 user nova-compute[72904]:       <nova:name>tempest-TestVolumeSwap-server-2035711756</nova:name>
Aug 27 04:59:02 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:59:02</nova:creationTime>
Aug 27 04:59:02 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:59:02 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:59:02 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:59:02 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:59:02 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:59:02 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:59:02 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:59:02 user nova-compute[72904]:       <nova:owner>
Aug 27 04:59:02 user nova-compute[72904]:         <nova:user uuid="009cdc58f61f4837ab8d4ee79d8b2a5d">tempest-TestVolumeSwap-1120456123-project-member</nova:user>
Aug 27 04:59:02 user nova-compute[72904]:         <nova:project uuid="7d39e559d3e346078cd876c7f09913eb">tempest-TestVolumeSwap-1120456123</nova:project>
Aug 27 04:59:02 user nova-compute[72904]:       </nova:owner>
Aug 27 04:59:02 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:59:02 user nova-compute[72904]:       <nova:ports>
Aug 27 04:59:02 user nova-compute[72904]:         <nova:port uuid="6031cf82-e9e2-4c84-bac3-27d01d92c0fc">
Aug 27 04:59:02 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 04:59:02 user nova-compute[72904]:         </nova:port>
Aug 27 04:59:02 user nova-compute[72904]:       </nova:ports>
Aug 27 04:59:02 user nova-compute[72904]:     </nova:instance>
Aug 27 04:59:02 user nova-compute[72904]:   </metadata>
Aug 27 04:59:02 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:59:02 user nova-compute[72904]:     <system>
Aug 27 04:59:02 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:59:02 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:59:02 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:59:02 user nova-compute[72904]:       <entry name="serial">3853715e-fce2-4c7c-b2a1-b8875866e0e8</entry>
Aug 27 04:59:02 user nova-compute[72904]:       <entry name="uuid">3853715e-fce2-4c7c-b2a1-b8875866e0e8</entry>
Aug 27 04:59:02 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:59:02 user nova-compute[72904]:     </system>
Aug 27 04:59:02 user nova-compute[72904]:   </sysinfo>
Aug 27 04:59:02 user nova-compute[72904]:   <os>
Aug 27 04:59:02 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:59:02 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:59:02 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:59:02 user nova-compute[72904]:   </os>
Aug 27 04:59:02 user nova-compute[72904]:   <features>
Aug 27 04:59:02 user nova-compute[72904]:     <acpi/>
Aug 27 04:59:02 user nova-compute[72904]:     <apic/>
Aug 27 04:59:02 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:59:02 user nova-compute[72904]:   </features>
Aug 27 04:59:02 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:59:02 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:59:02 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:59:02 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:59:02 user nova-compute[72904]:   </clock>
Aug 27 04:59:02 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:59:02 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:59:02 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:59:02 user nova-compute[72904]:   </cpu>
Aug 27 04:59:02 user nova-compute[72904]:   <devices>
Aug 27 04:59:02 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:59:02 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:59:02 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk"/>
Aug 27 04:59:02 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:59:02 user nova-compute[72904]:     </disk>
Aug 27 04:59:02 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:59:02 user nova-compute[72904]:       <mac address="fa:16:3e:08:c5:91"/>
Aug 27 04:59:02 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:02 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:59:02 user nova-compute[72904]:       <target dev="tap6031cf82-e9"/>
Aug 27 04:59:02 user nova-compute[72904]:     </interface>
Aug 27 04:59:02 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:59:02 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/console.log" append="off"/>
Aug 27 04:59:02 user nova-compute[72904]:     </serial>
Aug 27 04:59:02 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:59:02 user nova-compute[72904]:     <video>
Aug 27 04:59:02 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:02 user nova-compute[72904]:     </video>
Aug 27 04:59:02 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:59:02 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:59:02 user nova-compute[72904]:     </rng>
Aug 27 04:59:02 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:59:02 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:59:02 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:59:02 user nova-compute[72904]:     </memballoon>
Aug 27 04:59:02 user nova-compute[72904]:   </devices>
Aug 27 04:59:02 user nova-compute[72904]: </domain>
Aug 27 04:59:02 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2035711756',display_name='tempest-TestVolumeSwap-server-2035711756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2035711756',id=5,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG5tbNsTozwwOnECGSs75JugxZ7RFsybYiUzavaqNwtsph4/BrBgkRw4vTKnUd+27e2W89Qpvrg1c0PErbqulh4VKfZS/KS2/KW3hhzHsRZk97at26jd1ojPO0rZjlUhw==',key_name='tempest-keypair-1212211526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d39e559d3e346078cd876c7f09913eb',ramdisk_id='',reservation_id='r-byk0xos9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1120456123',owner_user_name='tempest-TestVolumeSwap-1120456123-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:58:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='009cdc58f61f4837ab8d4ee79d8b2a5d',uuid=3853715e-fce2-4c7c-b2a1-b8875866e0e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Converting VIF {"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:c5:91,bridge_name='br-int',has_traffic_filtering=True,id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc,network=Network(bde7ad3f-f2d3-4565-b777-00d2c70feddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6031cf82-e9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG os_vif [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c5:91,bridge_name='br-int',has_traffic_filtering=True,id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc,network=Network(bde7ad3f-f2d3-4565-b777-00d2c70feddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6031cf82-e9') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Cannot resize image /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Ensure instance console log exists: /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6031cf82-e9, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6031cf82-e9, col_values=(('external_ids', {'iface-id': '6031cf82-e9e2-4c84-bac3-27d01d92c0fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:c5:91', 'vm-uuid': '3853715e-fce2-4c7c-b2a1-b8875866e0e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:02 user nova-compute[72904]: INFO os_vif [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:c5:91,bridge_name='br-int',has_traffic_filtering=True,id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc,network=Network(bde7ad3f-f2d3-4565-b777-00d2c70feddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6031cf82-e9')
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] No VIF found with MAC fa:16:3e:08:c5:91, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.956s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.360s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:59:02 user nova-compute[72904]: INFO nova.compute.claims [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Claim successful on node user
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:59:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:59:02 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.policy [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aad703280f584c9da9c6aeb37d328dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8b8fa582214642ba95f4e685a954c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:59:03 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Creating image(s)
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updated VIF entry in instance network info cache for port 6031cf82-e9e2-4c84-bac3-27d01d92c0fc. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updating instance_info_cache with network_info: [{"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5b0237ee-7e2a-4948-9e2b-cf6bfdd38092 req-6b5e0942-61c8-4bee-8fe2-ffd70cbfabe0 service nova] Releasing lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.275s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.917s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Successfully updated port: 99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquired lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-changed-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Refreshing instance network info cache due to event network-changed-99601399-a7c6-4528-8750-14287da7d02d. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] Acquiring lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.334s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:03 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 27 04:59:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk 1073741824" returned: 0 in 0.138s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.479s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG nova.policy [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e99acb565174514ac7fd967dcc349c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8631ec28830b4d03b2d50d5f1d74659d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:59:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Creating image(s)
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "/opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "/opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "0c47d8505414b1c118d8aea24bd5dcab7898143b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "0c47d8505414b1c118d8aea24bd5dcab7898143b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.986s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Cannot resize image /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Ensure instance console log exists: /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.part --force-share --output=json" returned: 0 in 0.284s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.virt.images [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.part /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received event network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.019s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] No waiting events found dispatching network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:05 user nova-compute[72904]: WARNING nova.compute.manager [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received unexpected event network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 for instance with vm_state active and task_state None.
Aug 27 04:59:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received event network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] No waiting events found dispatching network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:06 user nova-compute[72904]: WARNING nova.compute.manager [req-eff7ee74-05bc-4573-9b1f-e2512f872f2b req-95bbbf57-c83d-4a66-b9fd-9c21d5e76410 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received unexpected event network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 for instance with vm_state active and task_state None.
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updating instance_info_cache with network_info: [{"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.part /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.converted" returned: 0 in 0.586s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Releasing lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Instance network_info: |[{"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] Acquired lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Refreshing network info cache for port 99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Start _get_guest_xml network_info=[{"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:59:06 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:06 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1065481276',display_name='tempest-VolumesAdminNegativeTest-server-1065481276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1065481276',id=6,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID1Cqes+vdZxYwuqVZebrL1J1HljqFqVd2LKgJcFiJhbLMtyTH1+MfNjFD6SXcST83Hu9Jffm6U//qndSB4v6MHzlgqpLDV5h8+1ev12oxzlaIM//q0xGMAvP43D5PeEg==',key_name='tempest-keypair-372493157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97d22ddf3716486784e9bc8d39420d63',ramdisk_id='',reservation_id='r-uk23fs4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1562447872',owner_user_name='tempest-VolumesAdminNegativeTest-1562447872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa245527faf42099b0bcefbad8e9a13',uuid=660b1c77-120e-40d5-b698-b89ec506caf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converting VIF {"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a9:5f,bridge_name='br-int',has_traffic_filtering=True,id=99601399-a7c6-4528-8750-14287da7d02d,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99601399-a7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.objects.instance [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lazy-loading 'pci_devices' on Instance uuid 660b1c77-120e-40d5-b698-b89ec506caf3 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.network.neutron [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Successfully created port: 64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:59:06 user nova-compute[72904]:   <uuid>660b1c77-120e-40d5-b698-b89ec506caf3</uuid>
Aug 27 04:59:06 user nova-compute[72904]:   <name>instance-00000006</name>
Aug 27 04:59:06 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:59:06 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:59:06 user nova-compute[72904]:   <metadata>
Aug 27 04:59:06 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:59:06 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:59:06 user nova-compute[72904]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1065481276</nova:name>
Aug 27 04:59:06 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:59:06</nova:creationTime>
Aug 27 04:59:06 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:59:06 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:59:06 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:59:06 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:59:06 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:59:06 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:59:06 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:59:06 user nova-compute[72904]:       <nova:owner>
Aug 27 04:59:06 user nova-compute[72904]:         <nova:user uuid="3aa245527faf42099b0bcefbad8e9a13">tempest-VolumesAdminNegativeTest-1562447872-project-member</nova:user>
Aug 27 04:59:06 user nova-compute[72904]:         <nova:project uuid="97d22ddf3716486784e9bc8d39420d63">tempest-VolumesAdminNegativeTest-1562447872</nova:project>
Aug 27 04:59:06 user nova-compute[72904]:       </nova:owner>
Aug 27 04:59:06 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:59:06 user nova-compute[72904]:       <nova:ports>
Aug 27 04:59:06 user nova-compute[72904]:         <nova:port uuid="99601399-a7c6-4528-8750-14287da7d02d">
Aug 27 04:59:06 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 04:59:06 user nova-compute[72904]:         </nova:port>
Aug 27 04:59:06 user nova-compute[72904]:       </nova:ports>
Aug 27 04:59:06 user nova-compute[72904]:     </nova:instance>
Aug 27 04:59:06 user nova-compute[72904]:   </metadata>
Aug 27 04:59:06 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:59:06 user nova-compute[72904]:     <system>
Aug 27 04:59:06 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:59:06 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:59:06 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:59:06 user nova-compute[72904]:       <entry name="serial">660b1c77-120e-40d5-b698-b89ec506caf3</entry>
Aug 27 04:59:06 user nova-compute[72904]:       <entry name="uuid">660b1c77-120e-40d5-b698-b89ec506caf3</entry>
Aug 27 04:59:06 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:59:06 user nova-compute[72904]:     </system>
Aug 27 04:59:06 user nova-compute[72904]:   </sysinfo>
Aug 27 04:59:06 user nova-compute[72904]:   <os>
Aug 27 04:59:06 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:59:06 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:59:06 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:59:06 user nova-compute[72904]:   </os>
Aug 27 04:59:06 user nova-compute[72904]:   <features>
Aug 27 04:59:06 user nova-compute[72904]:     <acpi/>
Aug 27 04:59:06 user nova-compute[72904]:     <apic/>
Aug 27 04:59:06 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:59:06 user nova-compute[72904]:   </features>
Aug 27 04:59:06 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:59:06 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:59:06 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:59:06 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:59:06 user nova-compute[72904]:   </clock>
Aug 27 04:59:06 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:59:06 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:59:06 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:59:06 user nova-compute[72904]:   </cpu>
Aug 27 04:59:06 user nova-compute[72904]:   <devices>
Aug 27 04:59:06 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:59:06 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:59:06 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk"/>
Aug 27 04:59:06 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:59:06 user nova-compute[72904]:     </disk>
Aug 27 04:59:06 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:59:06 user nova-compute[72904]:       <mac address="fa:16:3e:65:a9:5f"/>
Aug 27 04:59:06 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:06 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:59:06 user nova-compute[72904]:       <target dev="tap99601399-a7"/>
Aug 27 04:59:06 user nova-compute[72904]:     </interface>
Aug 27 04:59:06 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:59:06 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/console.log" append="off"/>
Aug 27 04:59:06 user nova-compute[72904]:     </serial>
Aug 27 04:59:06 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:59:06 user nova-compute[72904]:     <video>
Aug 27 04:59:06 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:06 user nova-compute[72904]:     </video>
Aug 27 04:59:06 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:59:06 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:59:06 user nova-compute[72904]:     </rng>
Aug 27 04:59:06 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:59:06 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:59:06 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:59:06 user nova-compute[72904]:     </memballoon>
Aug 27 04:59:06 user nova-compute[72904]:   </devices>
Aug 27 04:59:06 user nova-compute[72904]: </domain>
Aug 27 04:59:06 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1065481276',display_name='tempest-VolumesAdminNegativeTest-server-1065481276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1065481276',id=6,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID1Cqes+vdZxYwuqVZebrL1J1HljqFqVd2LKgJcFiJhbLMtyTH1+MfNjFD6SXcST83Hu9Jffm6U//qndSB4v6MHzlgqpLDV5h8+1ev12oxzlaIM//q0xGMAvP43D5PeEg==',key_name='tempest-keypair-372493157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97d22ddf3716486784e9bc8d39420d63',ramdisk_id='',reservation_id='r-uk23fs4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1562447872',owner_user_name='tempest-VolumesAdminNegativeTest-1562447872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa245527faf42099b0bcefbad8e9a13',uuid=660b1c77-120e-40d5-b698-b89ec506caf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converting VIF {"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:a9:5f,bridge_name='br-int',has_traffic_filtering=True,id=99601399-a7c6-4528-8750-14287da7d02d,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99601399-a7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG os_vif [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a9:5f,bridge_name='br-int',has_traffic_filtering=True,id=99601399-a7c6-4528-8750-14287da7d02d,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99601399-a7') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99601399-a7, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99601399-a7, col_values=(('external_ids', {'iface-id': '99601399-a7c6-4528-8750-14287da7d02d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:a9:5f', 'vm-uuid': '660b1c77-120e-40d5-b698-b89ec506caf3'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:06 user nova-compute[72904]: INFO os_vif [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:a9:5f,bridge_name='br-int',has_traffic_filtering=True,id=99601399-a7c6-4528-8750-14287da7d02d,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99601399-a7')
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b.converted --force-share --output=json" returned: 0 in 0.311s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "0c47d8505414b1c118d8aea24bd5dcab7898143b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.134s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] No VIF found with MAC fa:16:3e:65:a9:5f, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b --force-share --output=json" returned: 0 in 0.343s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "0c47d8505414b1c118d8aea24bd5dcab7898143b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "0c47d8505414b1c118d8aea24bd5dcab7898143b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b --force-share --output=json" returned: 0 in 0.261s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b,backing_fmt=raw /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b,backing_fmt=raw /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk 1073741824" returned: 0 in 0.053s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "0c47d8505414b1c118d8aea24bd5dcab7898143b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-d91b498f-bb3e-4ed1-b124-4db5e944d520 req-8de81b98-c5a9-4215-99f0-d4fec966e13a service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received event network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d91b498f-bb3e-4ed1-b124-4db5e944d520 req-8de81b98-c5a9-4215-99f0-d4fec966e13a service nova] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d91b498f-bb3e-4ed1-b124-4db5e944d520 req-8de81b98-c5a9-4215-99f0-d4fec966e13a service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d91b498f-bb3e-4ed1-b124-4db5e944d520 req-8de81b98-c5a9-4215-99f0-d4fec966e13a service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-d91b498f-bb3e-4ed1-b124-4db5e944d520 req-8de81b98-c5a9-4215-99f0-d4fec966e13a service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] No waiting events found dispatching network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:07 user nova-compute[72904]: WARNING nova.compute.manager [req-d91b498f-bb3e-4ed1-b124-4db5e944d520 req-8de81b98-c5a9-4215-99f0-d4fec966e13a service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received unexpected event network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 for instance with vm_state active and task_state None.
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.network.neutron [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Successfully created port: 6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b --force-share --output=json" returned: 0 in 0.229s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updated VIF entry in instance network info cache for port 99601399-a7c6-4528-8750-14287da7d02d. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updating instance_info_cache with network_info: [{"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b9114dc5-d8fd-4c2e-a68b-43390189b0a4 req-8091c511-6f05-4550-a576-dab6205f55a5 service nova] Releasing lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Cannot resize image /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Ensure instance console log exists: /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112348.6098282, 3853715e-fce2-4c7c-b2a1-b8875866e0e8 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] VM Resumed (Lifecycle Event)
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:59:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Instance spawned successfully.
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112348.6102374, 3853715e-fce2-4c7c-b2a1-b8875866e0e8 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] VM Started (Lifecycle Event)
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:08 user nova-compute[72904]: INFO nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Took 9.64 seconds to spawn the instance on the hypervisor.
Aug 27 04:59:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:08 user nova-compute[72904]: INFO nova.compute.manager [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Took 10.70 seconds to build instance.
Aug 27 04:59:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0aaa75a-4021-4509-b917-727325691343 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.890s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Successfully updated port: 64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquired lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received event network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] No waiting events found dispatching network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:09 user nova-compute[72904]: WARNING nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received unexpected event network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 for instance with vm_state active and task_state None.
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:09 user nova-compute[72904]: WARNING nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state None.
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:09 user nova-compute[72904]: WARNING nova.compute.manager [req-d59b42e6-193a-4394-bef1-adc49a84a7ee req-74924808-1134-4121-b751-d193b1bbfdf6 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state None.
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-changed-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Refreshing instance network info cache due to event network-changed-64c8e17d-17d8-49b8-8264-b8b56c9c27c0. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] Acquiring lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Successfully updated port: 6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquired lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating instance_info_cache with network_info: [{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Releasing lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Instance network_info: |[{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] Acquired lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Refreshing network info cache for port 64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Start _get_guest_xml network_info=[{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:59:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1342835485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1342835485',id=7,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAciaZPZaCJGxXOOKlsbJ//xWfo4ksogNHfXMFLKueAWuieNVHgrMq6LO1M4N0Uyjna8u9qjgK5y9el1SbwjNLuHaSB/p3SpBWGFdOSomnz5j6eWVQ97zEHQWWQdnd6WfA==',key_name='tempest-keypair-109214732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee8b8fa582214642ba95f4e685a954c8',ramdisk_id='',reservation_id='r-0e137ibn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-67395385',owner_user_name='tempest-TaggedAttachmentsTest-67395385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad703280f584c9da9c6aeb37d328dc2',uuid=e165c9ab-f2e0-43b4-bdcd-d92abd46c424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converting VIF {"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fc:49,bridge_name='br-int',has_traffic_filtering=True,id=64c8e17d-17d8-49b8-8264-b8b56c9c27c0,network=Network(604b446c-c3e7-4a25-9278-1ac6156294b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c8e17d-17') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.objects.instance [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'pci_devices' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:59:09 user nova-compute[72904]:   <uuid>e165c9ab-f2e0-43b4-bdcd-d92abd46c424</uuid>
Aug 27 04:59:09 user nova-compute[72904]:   <name>instance-00000007</name>
Aug 27 04:59:09 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:59:09 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:59:09 user nova-compute[72904]:   <metadata>
Aug 27 04:59:09 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:59:09 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:59:09 user nova-compute[72904]:       <nova:name>tempest-device-tagging-server-1342835485</nova:name>
Aug 27 04:59:09 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:59:09</nova:creationTime>
Aug 27 04:59:09 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:59:09 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:59:09 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:59:09 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:59:09 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:59:09 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:59:09 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:59:09 user nova-compute[72904]:       <nova:owner>
Aug 27 04:59:09 user nova-compute[72904]:         <nova:user uuid="aad703280f584c9da9c6aeb37d328dc2">tempest-TaggedAttachmentsTest-67395385-project-member</nova:user>
Aug 27 04:59:09 user nova-compute[72904]:         <nova:project uuid="ee8b8fa582214642ba95f4e685a954c8">tempest-TaggedAttachmentsTest-67395385</nova:project>
Aug 27 04:59:09 user nova-compute[72904]:       </nova:owner>
Aug 27 04:59:09 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:59:09 user nova-compute[72904]:       <nova:ports>
Aug 27 04:59:09 user nova-compute[72904]:         <nova:port uuid="64c8e17d-17d8-49b8-8264-b8b56c9c27c0">
Aug 27 04:59:09 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 04:59:09 user nova-compute[72904]:         </nova:port>
Aug 27 04:59:09 user nova-compute[72904]:       </nova:ports>
Aug 27 04:59:09 user nova-compute[72904]:     </nova:instance>
Aug 27 04:59:09 user nova-compute[72904]:   </metadata>
Aug 27 04:59:09 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:59:09 user nova-compute[72904]:     <system>
Aug 27 04:59:09 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:59:09 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:59:09 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:59:09 user nova-compute[72904]:       <entry name="serial">e165c9ab-f2e0-43b4-bdcd-d92abd46c424</entry>
Aug 27 04:59:09 user nova-compute[72904]:       <entry name="uuid">e165c9ab-f2e0-43b4-bdcd-d92abd46c424</entry>
Aug 27 04:59:09 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:59:09 user nova-compute[72904]:     </system>
Aug 27 04:59:09 user nova-compute[72904]:   </sysinfo>
Aug 27 04:59:09 user nova-compute[72904]:   <os>
Aug 27 04:59:09 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:59:09 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:59:09 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:59:09 user nova-compute[72904]:   </os>
Aug 27 04:59:09 user nova-compute[72904]:   <features>
Aug 27 04:59:09 user nova-compute[72904]:     <acpi/>
Aug 27 04:59:09 user nova-compute[72904]:     <apic/>
Aug 27 04:59:09 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:59:09 user nova-compute[72904]:   </features>
Aug 27 04:59:09 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:59:09 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:59:09 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:59:09 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:59:09 user nova-compute[72904]:   </clock>
Aug 27 04:59:09 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:59:09 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:59:09 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:59:09 user nova-compute[72904]:   </cpu>
Aug 27 04:59:09 user nova-compute[72904]:   <devices>
Aug 27 04:59:09 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:59:09 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:59:09 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk"/>
Aug 27 04:59:09 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:59:09 user nova-compute[72904]:     </disk>
Aug 27 04:59:09 user nova-compute[72904]:     <disk type="file" device="cdrom">
Aug 27 04:59:09 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 04:59:09 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.config"/>
Aug 27 04:59:09 user nova-compute[72904]:       <target dev="hda" bus="ide"/>
Aug 27 04:59:09 user nova-compute[72904]:     </disk>
Aug 27 04:59:09 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:59:09 user nova-compute[72904]:       <mac address="fa:16:3e:5c:fc:49"/>
Aug 27 04:59:09 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:09 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:59:09 user nova-compute[72904]:       <target dev="tap64c8e17d-17"/>
Aug 27 04:59:09 user nova-compute[72904]:     </interface>
Aug 27 04:59:09 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:59:09 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/console.log" append="off"/>
Aug 27 04:59:09 user nova-compute[72904]:     </serial>
Aug 27 04:59:09 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:59:09 user nova-compute[72904]:     <video>
Aug 27 04:59:09 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:09 user nova-compute[72904]:     </video>
Aug 27 04:59:09 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:59:09 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:59:09 user nova-compute[72904]:     </rng>
Aug 27 04:59:09 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:59:09 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:59:09 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:59:09 user nova-compute[72904]:     </memballoon>
Aug 27 04:59:09 user nova-compute[72904]:   </devices>
Aug 27 04:59:09 user nova-compute[72904]: </domain>
Aug 27 04:59:09 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1342835485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1342835485',id=7,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAciaZPZaCJGxXOOKlsbJ//xWfo4ksogNHfXMFLKueAWuieNVHgrMq6LO1M4N0Uyjna8u9qjgK5y9el1SbwjNLuHaSB/p3SpBWGFdOSomnz5j6eWVQ97zEHQWWQdnd6WfA==',key_name='tempest-keypair-109214732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee8b8fa582214642ba95f4e685a954c8',ramdisk_id='',reservation_id='r-0e137ibn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-67395385',owner_user_name='tempest-TaggedAttachmentsTest-67395385-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad703280f584c9da9c6aeb37d328dc2',uuid=e165c9ab-f2e0-43b4-bdcd-d92abd46c424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converting VIF {"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fc:49,bridge_name='br-int',has_traffic_filtering=True,id=64c8e17d-17d8-49b8-8264-b8b56c9c27c0,network=Network(604b446c-c3e7-4a25-9278-1ac6156294b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c8e17d-17') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG os_vif [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fc:49,bridge_name='br-int',has_traffic_filtering=True,id=64c8e17d-17d8-49b8-8264-b8b56c9c27c0,network=Network(604b446c-c3e7-4a25-9278-1ac6156294b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c8e17d-17') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Updating instance_info_cache with network_info: [{"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c8e17d-17, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64c8e17d-17, col_values=(('external_ids', {'iface-id': '64c8e17d-17d8-49b8-8264-b8b56c9c27c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:fc:49', 'vm-uuid': 'e165c9ab-f2e0-43b4-bdcd-d92abd46c424'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:09 user nova-compute[72904]: INFO os_vif [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fc:49,bridge_name='br-int',has_traffic_filtering=True,id=64c8e17d-17d8-49b8-8264-b8b56c9c27c0,network=Network(604b446c-c3e7-4a25-9278-1ac6156294b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c8e17d-17')
Aug 27 04:59:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Releasing lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Instance network_info: |[{"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Start _get_guest_xml network_info=[{"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:58:53Z,direct_url=<?>,disk_format='qcow2',id=ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca,min_disk=0,min_ram=0,name='',owner='0a710c3d15294a6ca32833831a3b011b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:58:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/sda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'scsi', 'image_id': 'ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:59:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:58:53Z,direct_url=<?>,disk_format='qcow2',id=ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca,min_disk=0,min_ram=0,name='',owner='0a710c3d15294a6ca32833831a3b011b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:58:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:59:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1833071487',display_name='tempest-AttachSCSIVolumeTestJSON-server-1833071487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1833071487',id=8,image_ref='ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhzoCvsJ9hF044kOEcF9VPtNh0HZSTODlMWaTE60QTBIBKxt2epYGZuroTneohQaseFt7Y/7Di/dqs/kWTYQn1k215JDclVJQn0oFUo07oEgVkPWcy+jciY5kxATaxqQw==',key_name='tempest-keypair-1833873001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8631ec28830b4d03b2d50d5f1d74659d',ramdisk_id='',reservation_id='r-le2slgul',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-13329697',owner_user_name='tempest-AttachSCSIVolumeTestJSON-13329697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99acb565174514ac7fd967dcc349c8',uuid=b2fdad0c-92d6-4af6-b3aa-db138564bdf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Converting VIF {"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7,network=Network(78f2587e-093c-476a-a5d0-e3066d7b3418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d52553f-4d') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.objects.instance [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lazy-loading 'pci_devices' on Instance uuid b2fdad0c-92d6-4af6-b3aa-db138564bdf0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:59:10 user nova-compute[72904]:   <uuid>b2fdad0c-92d6-4af6-b3aa-db138564bdf0</uuid>
Aug 27 04:59:10 user nova-compute[72904]:   <name>instance-00000008</name>
Aug 27 04:59:10 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:59:10 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:59:10 user nova-compute[72904]:   <metadata>
Aug 27 04:59:10 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:59:10 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:59:10 user nova-compute[72904]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1833071487</nova:name>
Aug 27 04:59:10 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:59:09</nova:creationTime>
Aug 27 04:59:10 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:59:10 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:59:10 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:59:10 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:59:10 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:59:10 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:59:10 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:59:10 user nova-compute[72904]:       <nova:owner>
Aug 27 04:59:10 user nova-compute[72904]:         <nova:user uuid="8e99acb565174514ac7fd967dcc349c8">tempest-AttachSCSIVolumeTestJSON-13329697-project-member</nova:user>
Aug 27 04:59:10 user nova-compute[72904]:         <nova:project uuid="8631ec28830b4d03b2d50d5f1d74659d">tempest-AttachSCSIVolumeTestJSON-13329697</nova:project>
Aug 27 04:59:10 user nova-compute[72904]:       </nova:owner>
Aug 27 04:59:10 user nova-compute[72904]:       <nova:root type="image" uuid="ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca"/>
Aug 27 04:59:10 user nova-compute[72904]:       <nova:ports>
Aug 27 04:59:10 user nova-compute[72904]:         <nova:port uuid="6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7">
Aug 27 04:59:10 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 04:59:10 user nova-compute[72904]:         </nova:port>
Aug 27 04:59:10 user nova-compute[72904]:       </nova:ports>
Aug 27 04:59:10 user nova-compute[72904]:     </nova:instance>
Aug 27 04:59:10 user nova-compute[72904]:   </metadata>
Aug 27 04:59:10 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:59:10 user nova-compute[72904]:     <system>
Aug 27 04:59:10 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:59:10 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:59:10 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:59:10 user nova-compute[72904]:       <entry name="serial">b2fdad0c-92d6-4af6-b3aa-db138564bdf0</entry>
Aug 27 04:59:10 user nova-compute[72904]:       <entry name="uuid">b2fdad0c-92d6-4af6-b3aa-db138564bdf0</entry>
Aug 27 04:59:10 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:59:10 user nova-compute[72904]:     </system>
Aug 27 04:59:10 user nova-compute[72904]:   </sysinfo>
Aug 27 04:59:10 user nova-compute[72904]:   <os>
Aug 27 04:59:10 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:59:10 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:59:10 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:59:10 user nova-compute[72904]:   </os>
Aug 27 04:59:10 user nova-compute[72904]:   <features>
Aug 27 04:59:10 user nova-compute[72904]:     <acpi/>
Aug 27 04:59:10 user nova-compute[72904]:     <apic/>
Aug 27 04:59:10 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:59:10 user nova-compute[72904]:   </features>
Aug 27 04:59:10 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:59:10 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:59:10 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:59:10 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:59:10 user nova-compute[72904]:   </clock>
Aug 27 04:59:10 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:59:10 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:59:10 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:59:10 user nova-compute[72904]:   </cpu>
Aug 27 04:59:10 user nova-compute[72904]:   <devices>
Aug 27 04:59:10 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:59:10 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:59:10 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk"/>
Aug 27 04:59:10 user nova-compute[72904]:       <target dev="sda" bus="scsi"/>
Aug 27 04:59:10 user nova-compute[72904]:       <address type="drive" controller="0" unit="0"/>
Aug 27 04:59:10 user nova-compute[72904]:     </disk>
Aug 27 04:59:10 user nova-compute[72904]:     <disk type="file" device="cdrom">
Aug 27 04:59:10 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 04:59:10 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk.config"/>
Aug 27 04:59:10 user nova-compute[72904]:       <target dev="sdb" bus="scsi"/>
Aug 27 04:59:10 user nova-compute[72904]:       <address type="drive" controller="0" unit="1"/>
Aug 27 04:59:10 user nova-compute[72904]:     </disk>
Aug 27 04:59:10 user nova-compute[72904]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 27 04:59:10 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:59:10 user nova-compute[72904]:       <mac address="fa:16:3e:de:d1:ef"/>
Aug 27 04:59:10 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:10 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:59:10 user nova-compute[72904]:       <target dev="tap6d52553f-4d"/>
Aug 27 04:59:10 user nova-compute[72904]:     </interface>
Aug 27 04:59:10 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:59:10 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/console.log" append="off"/>
Aug 27 04:59:10 user nova-compute[72904]:     </serial>
Aug 27 04:59:10 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:59:10 user nova-compute[72904]:     <video>
Aug 27 04:59:10 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:10 user nova-compute[72904]:     </video>
Aug 27 04:59:10 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:59:10 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:59:10 user nova-compute[72904]:     </rng>
Aug 27 04:59:10 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:59:10 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:59:10 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:59:10 user nova-compute[72904]:     </memballoon>
Aug 27 04:59:10 user nova-compute[72904]:   </devices>
Aug 27 04:59:10 user nova-compute[72904]: </domain>
Aug 27 04:59:10 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1833071487',display_name='tempest-AttachSCSIVolumeTestJSON-server-1833071487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1833071487',id=8,image_ref='ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhzoCvsJ9hF044kOEcF9VPtNh0HZSTODlMWaTE60QTBIBKxt2epYGZuroTneohQaseFt7Y/7Di/dqs/kWTYQn1k215JDclVJQn0oFUo07oEgVkPWcy+jciY5kxATaxqQw==',key_name='tempest-keypair-1833873001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8631ec28830b4d03b2d50d5f1d74659d',ramdisk_id='',reservation_id='r-le2slgul',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-13329697',owner_user_name='tempest-AttachSCSIVolumeTestJSON-13329697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99acb565174514ac7fd967dcc349c8',uuid=b2fdad0c-92d6-4af6-b3aa-db138564bdf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Converting VIF {"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7,network=Network(78f2587e-093c-476a-a5d0-e3066d7b3418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d52553f-4d') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG os_vif [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7,network=Network(78f2587e-093c-476a-a5d0-e3066d7b3418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d52553f-4d') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No BDM found with device name hda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No VIF found with MAC fa:16:3e:5c:fc:49, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Using config drive
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d52553f-4d, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d52553f-4d, col_values=(('external_ids', {'iface-id': '6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d1:ef', 'vm-uuid': 'b2fdad0c-92d6-4af6-b3aa-db138564bdf0'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:10 user nova-compute[72904]: INFO os_vif [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7,network=Network(78f2587e-093c-476a-a5d0-e3066d7b3418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d52553f-4d')
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] No BDM found with device name sda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] No VIF found with MAC fa:16:3e:de:d1:ef, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Using config drive
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Creating config drive at /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk.config
Aug 27 04:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp195ot150 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp195ot150" returned: 0 in 0.062s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Creating config drive at /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.config
Aug 27 04:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpruveq9en {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpruveq9en" returned: 0 in 0.057s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updated VIF entry in instance network info cache for port 64c8e17d-17d8-49b8-8264-b8b56c9c27c0. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating instance_info_cache with network_info: [{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b08877a0-98c2-45e3-89ef-33a5569a6789 req-72bbfe16-964b-4adc-8be5-3da1428383f0 service nova] Releasing lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112350.9057775, 660b1c77-120e-40d5-b698-b89ec506caf3 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] VM Resumed (Lifecycle Event)
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Instance spawned successfully.
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112350.9113333, 660b1c77-120e-40d5-b698-b89ec506caf3 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:10 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] VM Started (Lifecycle Event)
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:11 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:11 user nova-compute[72904]: INFO nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Took 9.90 seconds to spawn the instance on the hypervisor.
Aug 27 04:59:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:11 user nova-compute[72904]: INFO nova.compute.manager [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Took 11.28 seconds to build instance.
Aug 27 04:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52553dd9-1003-44e2-b8da-19c24c79ddb9 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.559s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-changed-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Refreshing instance network info cache due to event network-changed-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] Acquiring lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] Acquired lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Refreshing network info cache for port 6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Updated VIF entry in instance network info cache for port 6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Updating instance_info_cache with network_info: [{"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-94586859-616b-4d37-8547-5848787d88bc req-6f3866ef-ebad-4338-88ba-378ad65bd7e9 service nova] Releasing lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 04:59:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 04:59:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 04:59:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-8f4c0b7a-c724-4825-8fd8-86c2c2967ad4 req-5d5834ab-89d3-4f80-8e93-19c7c11893f6 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f4c0b7a-c724-4825-8fd8-86c2c2967ad4 req-5d5834ab-89d3-4f80-8e93-19c7c11893f6 service nova] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f4c0b7a-c724-4825-8fd8-86c2c2967ad4 req-5d5834ab-89d3-4f80-8e93-19c7c11893f6 service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f4c0b7a-c724-4825-8fd8-86c2c2967ad4 req-5d5834ab-89d3-4f80-8e93-19c7c11893f6 service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-8f4c0b7a-c724-4825-8fd8-86c2c2967ad4 req-5d5834ab-89d3-4f80-8e93-19c7c11893f6 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] No waiting events found dispatching network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:13 user nova-compute[72904]: WARNING nova.compute.manager [req-8f4c0b7a-c724-4825-8fd8-86c2c2967ad4 req-5d5834ab-89d3-4f80-8e93-19c7c11893f6 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received unexpected event network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 for instance with vm_state building and task_state spawning.
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-7a9294fa-03c3-4254-be94-d6eb0f1e65d6 req-6a614beb-cbd4-453b-976a-5c6b8fcbc7db service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7a9294fa-03c3-4254-be94-d6eb0f1e65d6 req-6a614beb-cbd4-453b-976a-5c6b8fcbc7db service nova] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7a9294fa-03c3-4254-be94-d6eb0f1e65d6 req-6a614beb-cbd4-453b-976a-5c6b8fcbc7db service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7a9294fa-03c3-4254-be94-d6eb0f1e65d6 req-6a614beb-cbd4-453b-976a-5c6b8fcbc7db service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-7a9294fa-03c3-4254-be94-d6eb0f1e65d6 req-6a614beb-cbd4-453b-976a-5c6b8fcbc7db service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] No waiting events found dispatching network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:15 user nova-compute[72904]: WARNING nova.compute.manager [req-7a9294fa-03c3-4254-be94-d6eb0f1e65d6 req-6a614beb-cbd4-453b-976a-5c6b8fcbc7db service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received unexpected event network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d for instance with vm_state active and task_state None.
Aug 27 04:59:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-393a5efe-1f8a-4aa3-be51-08e74547e3d0 req-d892ff01-ed73-4403-96cc-748f6c1041ad service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-393a5efe-1f8a-4aa3-be51-08e74547e3d0 req-d892ff01-ed73-4403-96cc-748f6c1041ad service nova] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-393a5efe-1f8a-4aa3-be51-08e74547e3d0 req-d892ff01-ed73-4403-96cc-748f6c1041ad service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-393a5efe-1f8a-4aa3-be51-08e74547e3d0 req-d892ff01-ed73-4403-96cc-748f6c1041ad service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-393a5efe-1f8a-4aa3-be51-08e74547e3d0 req-d892ff01-ed73-4403-96cc-748f6c1041ad service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] No waiting events found dispatching network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:15 user nova-compute[72904]: WARNING nova.compute.manager [req-393a5efe-1f8a-4aa3-be51-08e74547e3d0 req-d892ff01-ed73-4403-96cc-748f6c1041ad service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received unexpected event network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 for instance with vm_state building and task_state spawning.
Aug 27 04:59:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:15 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112356.4729974, e165c9ab-f2e0-43b4-bdcd-d92abd46c424 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] VM Resumed (Lifecycle Event)
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Instance spawned successfully.
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112356.4903338, e165c9ab-f2e0-43b4-bdcd-d92abd46c424 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] VM Started (Lifecycle Event)
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Took 13.42 seconds to spawn the instance on the hypervisor.
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112356.8202515, b2fdad0c-92d6-4af6-b3aa-db138564bdf0 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] VM Resumed (Lifecycle Event)
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:59:16 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Instance spawned successfully.
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:17 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112356.850565, b2fdad0c-92d6-4af6-b3aa-db138564bdf0 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:17 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] VM Started (Lifecycle Event)
Aug 27 04:59:17 user nova-compute[72904]: INFO nova.compute.manager [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Took 15.33 seconds to build instance.
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:17 user nova-compute[72904]: INFO nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Took 12.84 seconds to spawn the instance on the hypervisor.
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27338e3c-3935-4959-81da-3c10d0dd0c44 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.506s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:17 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:17 user nova-compute[72904]: INFO nova.compute.manager [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Took 14.88 seconds to build instance.
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-11075e16-3c7a-42e8-9876-4e3719f06454 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.096s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-c8d6ae06-642e-45a1-8129-f613d0de82eb req-cc046b92-e990-4b21-84ad-ea2769d0c038 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c8d6ae06-642e-45a1-8129-f613d0de82eb req-cc046b92-e990-4b21-84ad-ea2769d0c038 service nova] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c8d6ae06-642e-45a1-8129-f613d0de82eb req-cc046b92-e990-4b21-84ad-ea2769d0c038 service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c8d6ae06-642e-45a1-8129-f613d0de82eb req-cc046b92-e990-4b21-84ad-ea2769d0c038 service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-c8d6ae06-642e-45a1-8129-f613d0de82eb req-cc046b92-e990-4b21-84ad-ea2769d0c038 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] No waiting events found dispatching network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:17 user nova-compute[72904]: WARNING nova.compute.manager [req-c8d6ae06-642e-45a1-8129-f613d0de82eb req-cc046b92-e990-4b21-84ad-ea2769d0c038 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received unexpected event network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d for instance with vm_state active and task_state None.
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:59:17 user nova-compute[72904]: INFO nova.compute.claims [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Claim successful on node user
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:59:18 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.policy [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28c32ea246ad49f6aadbe75dce5a6b03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a49b21d9c614de4b372252fab908b25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 04:59:18 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Creating image(s)
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "/opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "/opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "/opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.251s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.226s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk 1073741824" returned: 0 in 0.114s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.216s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json" returned: 0 in 0.353s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Successfully created port: bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Cannot resize image /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Ensure instance console log exists: /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Successfully updated port: bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquired lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG nova.compute.manager [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-changed-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG nova.compute.manager [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Refreshing instance network info cache due to event network-changed-bf207583-6614-42c4-8d4a-1c22ff7d62e9. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] Acquiring lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7769MB free_disk=25.976299285888672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0324de51-3864-4a3b-bc2c-2046a9925275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance cae1202f-0f6c-437e-8334-215b4736e061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 660b1c77-120e-40d5-b698-b89ec506caf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 72995227-dd52-4b04-a119-41c34dc2e43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Updating instance_info_cache with network_info: [{"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Releasing lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Instance network_info: |[{"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] Acquired lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.network.neutron [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Refreshing network info cache for port bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Start _get_guest_xml network_info=[{"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 04:59:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1181321178',display_name='tempest-VolumesAssistedSnapshotsTest-server-1181321178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1181321178',id=9,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW9jVip3htRH3vqmeC6GmmURceEWcCNtEUdWyHOUrvJMFrDAr2nTKdopSuY7yQAizrYNdZ64pNKGMRoBwPJP7DVUDHO8PnlFrFfBb7xNlzZau2mQp7yi33cyYcPgIRgeg==',key_name='tempest-keypair-112656168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a49b21d9c614de4b372252fab908b25',ramdisk_id='',reservation_id='r-e704d4yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1073004250',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1073004250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28c32ea246ad49f6aadbe75dce5a6b03',uuid=72995227-dd52-4b04-a119-41c34dc2e43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Converting VIF {"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b6:fa,bridge_name='br-int',has_traffic_filtering=True,id=bf207583-6614-42c4-8d4a-1c22ff7d62e9,network=Network(f1cfc312-7fab-4faa-9bdc-8472a7b941c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf207583-66') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lazy-loading 'pci_devices' on Instance uuid 72995227-dd52-4b04-a119-41c34dc2e43b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 04:59:21 user nova-compute[72904]:   <uuid>72995227-dd52-4b04-a119-41c34dc2e43b</uuid>
Aug 27 04:59:21 user nova-compute[72904]:   <name>instance-00000009</name>
Aug 27 04:59:21 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 04:59:21 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 04:59:21 user nova-compute[72904]:   <metadata>
Aug 27 04:59:21 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 04:59:21 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 04:59:21 user nova-compute[72904]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1181321178</nova:name>
Aug 27 04:59:21 user nova-compute[72904]:       <nova:creationTime>2023-08-27 04:59:21</nova:creationTime>
Aug 27 04:59:21 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 04:59:21 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 04:59:21 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 04:59:21 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 04:59:21 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 04:59:21 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 04:59:21 user nova-compute[72904]:       </nova:flavor>
Aug 27 04:59:21 user nova-compute[72904]:       <nova:owner>
Aug 27 04:59:21 user nova-compute[72904]:         <nova:user uuid="28c32ea246ad49f6aadbe75dce5a6b03">tempest-VolumesAssistedSnapshotsTest-1073004250-project-member</nova:user>
Aug 27 04:59:21 user nova-compute[72904]:         <nova:project uuid="8a49b21d9c614de4b372252fab908b25">tempest-VolumesAssistedSnapshotsTest-1073004250</nova:project>
Aug 27 04:59:21 user nova-compute[72904]:       </nova:owner>
Aug 27 04:59:21 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 04:59:21 user nova-compute[72904]:       <nova:ports>
Aug 27 04:59:21 user nova-compute[72904]:         <nova:port uuid="bf207583-6614-42c4-8d4a-1c22ff7d62e9">
Aug 27 04:59:21 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 04:59:21 user nova-compute[72904]:         </nova:port>
Aug 27 04:59:21 user nova-compute[72904]:       </nova:ports>
Aug 27 04:59:21 user nova-compute[72904]:     </nova:instance>
Aug 27 04:59:21 user nova-compute[72904]:   </metadata>
Aug 27 04:59:21 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 04:59:21 user nova-compute[72904]:     <system>
Aug 27 04:59:21 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 04:59:21 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 04:59:21 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 04:59:21 user nova-compute[72904]:       <entry name="serial">72995227-dd52-4b04-a119-41c34dc2e43b</entry>
Aug 27 04:59:21 user nova-compute[72904]:       <entry name="uuid">72995227-dd52-4b04-a119-41c34dc2e43b</entry>
Aug 27 04:59:21 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 04:59:21 user nova-compute[72904]:     </system>
Aug 27 04:59:21 user nova-compute[72904]:   </sysinfo>
Aug 27 04:59:21 user nova-compute[72904]:   <os>
Aug 27 04:59:21 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 04:59:21 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 04:59:21 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 04:59:21 user nova-compute[72904]:   </os>
Aug 27 04:59:21 user nova-compute[72904]:   <features>
Aug 27 04:59:21 user nova-compute[72904]:     <acpi/>
Aug 27 04:59:21 user nova-compute[72904]:     <apic/>
Aug 27 04:59:21 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 04:59:21 user nova-compute[72904]:   </features>
Aug 27 04:59:21 user nova-compute[72904]:   <clock offset="utc">
Aug 27 04:59:21 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 04:59:21 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 04:59:21 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 04:59:21 user nova-compute[72904]:   </clock>
Aug 27 04:59:21 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 04:59:21 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 04:59:21 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 04:59:21 user nova-compute[72904]:   </cpu>
Aug 27 04:59:21 user nova-compute[72904]:   <devices>
Aug 27 04:59:21 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 04:59:21 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 04:59:21 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk"/>
Aug 27 04:59:21 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 04:59:21 user nova-compute[72904]:     </disk>
Aug 27 04:59:21 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 04:59:21 user nova-compute[72904]:       <mac address="fa:16:3e:26:b6:fa"/>
Aug 27 04:59:21 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:21 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 04:59:21 user nova-compute[72904]:       <target dev="tapbf207583-66"/>
Aug 27 04:59:21 user nova-compute[72904]:     </interface>
Aug 27 04:59:21 user nova-compute[72904]:     <serial type="pty">
Aug 27 04:59:21 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/console.log" append="off"/>
Aug 27 04:59:21 user nova-compute[72904]:     </serial>
Aug 27 04:59:21 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 04:59:21 user nova-compute[72904]:     <video>
Aug 27 04:59:21 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 04:59:21 user nova-compute[72904]:     </video>
Aug 27 04:59:21 user nova-compute[72904]:     <rng model="virtio">
Aug 27 04:59:21 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 04:59:21 user nova-compute[72904]:     </rng>
Aug 27 04:59:21 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 04:59:21 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 04:59:21 user nova-compute[72904]:       <stats period="10"/>
Aug 27 04:59:21 user nova-compute[72904]:     </memballoon>
Aug 27 04:59:21 user nova-compute[72904]:   </devices>
Aug 27 04:59:21 user nova-compute[72904]: </domain>
Aug 27 04:59:21 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1181321178',display_name='tempest-VolumesAssistedSnapshotsTest-server-1181321178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1181321178',id=9,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW9jVip3htRH3vqmeC6GmmURceEWcCNtEUdWyHOUrvJMFrDAr2nTKdopSuY7yQAizrYNdZ64pNKGMRoBwPJP7DVUDHO8PnlFrFfBb7xNlzZau2mQp7yi33cyYcPgIRgeg==',key_name='tempest-keypair-112656168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a49b21d9c614de4b372252fab908b25',ramdisk_id='',reservation_id='r-e704d4yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1073004250',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1073004250-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28c32ea246ad49f6aadbe75dce5a6b03',uuid=72995227-dd52-4b04-a119-41c34dc2e43b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Converting VIF {"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b6:fa,bridge_name='br-int',has_traffic_filtering=True,id=bf207583-6614-42c4-8d4a-1c22ff7d62e9,network=Network(f1cfc312-7fab-4faa-9bdc-8472a7b941c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf207583-66') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG os_vif [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b6:fa,bridge_name='br-int',has_traffic_filtering=True,id=bf207583-6614-42c4-8d4a-1c22ff7d62e9,network=Network(f1cfc312-7fab-4faa-9bdc-8472a7b941c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf207583-66') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf207583-66, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf207583-66, col_values=(('external_ids', {'iface-id': 'bf207583-6614-42c4-8d4a-1c22ff7d62e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:b6:fa', 'vm-uuid': '72995227-dd52-4b04-a119-41c34dc2e43b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:22 user nova-compute[72904]: INFO os_vif [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b6:fa,bridge_name='br-int',has_traffic_filtering=True,id=bf207583-6614-42c4-8d4a-1c22ff7d62e9,network=Network(f1cfc312-7fab-4faa-9bdc-8472a7b941c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf207583-66')
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] No VIF found with MAC fa:16:3e:26:b6:fa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.918s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Updated VIF entry in instance network info cache for port bf207583-6614-42c4-8d4a-1c22ff7d62e9. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Updating instance_info_cache with network_info: [{"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ff69c330-16e4-439b-b102-bd34d3004725 req-282dcb80-3a97-4807-bb5f-c100fc6b95f1 service nova] Releasing lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Skipping network cache update for instance because it is Building. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid 0324de51-3864-4a3b-bc2c-2046a9925275 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 04:59:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-48a6686d-cf26-4d13-bbba-ead40785ca99 req-2b34a569-838a-418c-ad8c-afe08f70bfb8 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48a6686d-cf26-4d13-bbba-ead40785ca99 req-2b34a569-838a-418c-ad8c-afe08f70bfb8 service nova] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48a6686d-cf26-4d13-bbba-ead40785ca99 req-2b34a569-838a-418c-ad8c-afe08f70bfb8 service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48a6686d-cf26-4d13-bbba-ead40785ca99 req-2b34a569-838a-418c-ad8c-afe08f70bfb8 service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-48a6686d-cf26-4d13-bbba-ead40785ca99 req-2b34a569-838a-418c-ad8c-afe08f70bfb8 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] No waiting events found dispatching network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:24 user nova-compute[72904]: WARNING nova.compute.manager [req-48a6686d-cf26-4d13-bbba-ead40785ca99 req-2b34a569-838a-418c-ad8c-afe08f70bfb8 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received unexpected event network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 for instance with vm_state building and task_state spawning.
Aug 27 04:59:24 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updating instance_info_cache with network_info: [{"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-0324de51-3864-4a3b-bc2c-2046a9925275" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-69741cf9-c88b-4b2c-9050-9eab594c7196 req-b005de57-1797-4765-8909-bb515e7c419d service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-69741cf9-c88b-4b2c-9050-9eab594c7196 req-b005de57-1797-4765-8909-bb515e7c419d service nova] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-69741cf9-c88b-4b2c-9050-9eab594c7196 req-b005de57-1797-4765-8909-bb515e7c419d service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-69741cf9-c88b-4b2c-9050-9eab594c7196 req-b005de57-1797-4765-8909-bb515e7c419d service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-69741cf9-c88b-4b2c-9050-9eab594c7196 req-b005de57-1797-4765-8909-bb515e7c419d service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] No waiting events found dispatching network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:24 user nova-compute[72904]: WARNING nova.compute.manager [req-69741cf9-c88b-4b2c-9050-9eab594c7196 req-b005de57-1797-4765-8909-bb515e7c419d service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received unexpected event network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc for instance with vm_state active and task_state None.
Aug 27 04:59:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-f76ff815-a759-405a-a839-96cfa7f7903a req-348ccd22-bdd0-45f4-b3ff-bd496c3ae876 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f76ff815-a759-405a-a839-96cfa7f7903a req-348ccd22-bdd0-45f4-b3ff-bd496c3ae876 service nova] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f76ff815-a759-405a-a839-96cfa7f7903a req-348ccd22-bdd0-45f4-b3ff-bd496c3ae876 service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f76ff815-a759-405a-a839-96cfa7f7903a req-348ccd22-bdd0-45f4-b3ff-bd496c3ae876 service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-f76ff815-a759-405a-a839-96cfa7f7903a req-348ccd22-bdd0-45f4-b3ff-bd496c3ae876 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] No waiting events found dispatching network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:26 user nova-compute[72904]: WARNING nova.compute.manager [req-f76ff815-a759-405a-a839-96cfa7f7903a req-348ccd22-bdd0-45f4-b3ff-bd496c3ae876 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received unexpected event network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 for instance with vm_state building and task_state spawning.
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112366.3827784, 72995227-dd52-4b04-a119-41c34dc2e43b => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:26 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] VM Resumed (Lifecycle Event)
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 04:59:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Instance spawned successfully.
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 04:59:26 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112366.3858027, 72995227-dd52-4b04-a119-41c34dc2e43b => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 04:59:26 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] VM Started (Lifecycle Event)
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 04:59:26 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 04:59:26 user nova-compute[72904]: INFO nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Took 7.53 seconds to spawn the instance on the hypervisor.
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 04:59:26 user nova-compute[72904]: INFO nova.compute.manager [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Took 9.01 seconds to build instance.
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f6ebebb9-86fc-45ad-b1a6-7100f9f46250 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.159s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] No waiting events found dispatching network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:26 user nova-compute[72904]: WARNING nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received unexpected event network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc for instance with vm_state active and task_state None.
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:26 user nova-compute[72904]: WARNING nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received unexpected event network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 for instance with vm_state active and task_state None.
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 04:59:26 user nova-compute[72904]: WARNING nova.compute.manager [req-6f94f247-f28d-4037-a97e-7848b90f7dce req-55a8db31-30cd-4520-95d8-4aaf70613635 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received unexpected event network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 for instance with vm_state active and task_state None.
Aug 27 04:59:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "94a31275-2023-4fc1-a2ca-887a126972e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 04:59:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 04:59:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 04:59:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 04:59:41 user nova-compute[72904]: INFO nova.compute.claims [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Claim successful on node user
Aug 27 04:59:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:42 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 04:59:42 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 04:59:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 04:59:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 04:59:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 04:59:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 04:59:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 04:59:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 04:59:42 user nova-compute[72904]: INFO nova.virt.block_device [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Booting with volume d76b2786-396b-4b98-bf0b-9233b9d4b3cb at /dev/vda
Aug 27 04:59:42 user nova-compute[72904]: DEBUG os_brick.utils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:59:42 user nova-compute[72904]: INFO oslo.privsep.daemon [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpw6swx43e/privsep.sock']
Aug 27 04:59:42 user sudo[84213]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpw6swx43e/privsep.sock
Aug 27 04:59:42 user sudo[84213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 27 04:59:42 user nova-compute[72904]: DEBUG nova.policy [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3eebf8c3b27c49feb6561c7c3af7b1a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3187574818a94f47aa4961397b84a79a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 04:59:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully created port: 6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully created port: 7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:44 user sudo[84213]: pam_unix(sudo:session): session closed for user root
Aug 27 04:59:44 user nova-compute[72904]: INFO oslo.privsep.daemon [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Spawned new privsep daemon via rootwrap
Aug 27 04:59:44 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 27 04:59:44 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 27 04:59:44 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 27 04:59:44 user nova-compute[72904]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84216
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[05895cc3-ff2e-4117-812e-094b41e8b671]: (2,) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[64208e23-f844-4c62-9963-b279853eb5a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:44 user nova-compute[72904]: WARNING os_brick.initiator.connectors.nvmeof [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f30851-97cc-4bd4-9645-cc0694beafb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9217b5-838a-4677-94bb-b2a708aeb54a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6308eaf-ad0e-4492-a225-5ef2c0babd16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully created port: 08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:59:44 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:59:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b33c1e-b45d-4ae0-b994-e7700179efbc]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG os_brick.utils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== get_connector_properties: return (2147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:59:44 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating existing volume attachment record: fa4cca91-e2cf-4bed-8d99-5f9e6a298a9e {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:59:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully created port: c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully created port: 9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully updated port: 6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-6b4be91f-fec1-4711-bcd3-1508e3483b83. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG nova.network.neutron [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port 6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:46 user nova-compute[72904]: DEBUG nova.network.neutron [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0f6d74d1-eea3-4df0-811c-c7f3e6159006 req-1d9e727d-1053-491a-abda-06de0d087fbd service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:48 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully updated port: d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-d94829ae-2209-414c-970a-d61335d88a33. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:49 user nova-compute[72904]: DEBUG nova.network.neutron [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:49 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully updated port: ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:49 user nova-compute[72904]: DEBUG nova.network.neutron [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81d503e2-b318-4aff-b033-1b6b305b6851 req-38db8fc8-5c8c-44ac-815a-06f7effcfdfe service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:49 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully updated port: 7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:50 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully updated port: 08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-ec18210c-eb48-42cb-9a7a-50e9a429e2ae. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-7022f918-bdc9-4834-8286-fc31b080657a. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port 7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-08acb973-7a38-4315-aa2f-e9b33b5fed31. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port 08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully updated port: c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-86cf2ede-c6a6-4e62-b877-f73b0a18c478 req-fbbcf261-4e25-4a72-b3a5-0a350323281b service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-c7e99438-d7fe-4404-b0ad-265fe223e15f. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Successfully updated port: 9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7bea480d-6293-4f81-8215-aab03e9ecf3b req-4d4fea79-f4a2-439c-8d67-6f366f954ab5 service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 04:59:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-9cd1a40c-3234-440a-afb4-057da3c9bc56. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [{"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance network_info: |[{"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG nova.network.neutron [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port 9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 04:59:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 04:59:56 user nova-compute[72904]: INFO nova.virt.block_device [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Booting with volume c5caa498-e3f9-497c-bae9-f2d0e27cbd22 at /dev/vdb
Aug 27 04:59:56 user nova-compute[72904]: DEBUG os_brick.utils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6cd7e1-6be5-4258-bd67-fa250e659923]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG nova.network.neutron [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updated VIF entry in instance network info cache for port 9cd1a40c-3234-440a-afb4-057da3c9bc56. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG nova.network.neutron [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [{"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6815e782-21d7-455a-9520-7fcb06c20e77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f596e12c-21a1-4b4f-8837-2a50b206a3e4 req-2fcf7719-5fd9-413e-b99e-3ca343a475d4 service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d53aa4-689f-4af4-855f-e343aa3db4ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fef1595-d287-43e2-bbb1-8c111dfd9c9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 04:59:56 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 04:59:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e039127c-942f-4e35-95a6-1e08ef3447d0]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG os_brick.utils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 04:59:56 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating existing volume attachment record: a2cc3972-7456-40da-bdb6-aac4d8718b5e {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 04:59:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:00:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:00:01 user nova-compute[72904]: INFO nova.compute.claims [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Claim successful on node user
Aug 27 05:00:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:00:02 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:00:02 user nova-compute[72904]: INFO nova.virt.block_device [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Booting with volume 8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 at /dev/vda
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.policy [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd346fd49936b48d4a55681a18b70f0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6ee805ec6241d0a7159d2add36aa10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG os_brick.utils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b8f3a6-44f7-47d2-8525-d80b2ee4c277]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a2603c-7b91-407c-871d-c4bc3c327687]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe92f9f-6517-4e33-8389-d3b232b70d20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fa8b51-a9d3-45e9-b1a1-cfec7f1c04ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:02 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:00:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e6eb3-6953-4e4a-910d-0da87edf0d3c]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG os_brick.utils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating existing volume attachment record: 974f1a92-1382-4285-a196-50ce48e4b133 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully created port: 04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:00:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully created port: 2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:00:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully created port: 2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:00:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully created port: 8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:00:05 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully created port: 20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully updated port: 04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-04b5cb8f-d374-4b57-a4d6-59a6338f88ae. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port 04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b1288de-9ee9-4188-9606-828510dc4738 req-5ac917cd-886f-4f09-91d0-a0f5c44455a8 service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:07 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully updated port: 44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-44588416-88f1-44a9-913d-0b4270e4c2c1. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG nova.network.neutron [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port 44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully updated port: decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG nova.network.neutron [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:08 user nova-compute[72904]: INFO nova.virt.block_device [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Booting with volume 0449deb8-a7b2-4f6b-a469-a8472837cfeb at /dev/vdc
Aug 27 05:00:08 user nova-compute[72904]: DEBUG os_brick.utils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df5eccd-bc17-4bbb-9a15-5eb13e3c00d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b482aacd-6eb3-4691-9b89-9ada188378d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[060262dc-165f-4dec-b793-3f73a893b971]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a019887-a8d9-41a3-95e9-0895d02bb2d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG nova.network.neutron [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fb51a0e0-13da-4c3d-bf7d-2b6887f16ea5 req-ec7d617f-d402-47bd-9fbd-dc1542951e0a service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:08 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:00:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[50149c6f-7b8e-49b1-aff1-f5a02979e232]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG os_brick.utils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:08 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating existing volume attachment record: 01885e22-b954-4463-95fa-2dfb7f1fc5d0 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:00:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully updated port: 2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully updated port: 2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-decd4865-3f96-4ebc-8c49-2e6e3342c870. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-2ef82d54-e731-4761-82fa-49fcc3a33dc0. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port 2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully updated port: 8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-2b6e6460-b500-4589-af0b-6927510c9e49. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port 2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-381a76a0-0064-42f3-a00b-fc30cbf82cce req-08f3d3f4-a570-44b0-8bcc-f96339c6f3de service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-8d8efd4c-6aad-4bdf-b865-080a929bb813. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.network.neutron [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port 8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Successfully updated port: 20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.network.neutron [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.network.neutron [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b5013012-c893-4b67-9f7c-bc370d8ecd0c req-1a65e48b-8cb3-4514-9ec4-3c8d1212850e service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:00:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-20686a0f-ec45-4c05-aae9-872242a5cd3e. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG nova.network.neutron [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance network_info: |[{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:14 user nova-compute[72904]: DEBUG nova.network.neutron [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port 20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updated VIF entry in instance network info cache for port 20686a0f-ec45-4c05-aae9-872242a5cd3e. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f483f51-5df0-4b18-b28b-073e328058b7 req-f3b46d10-8dc7-4a95-9578-4e201e9078c6 service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:00:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:17 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:00:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:00:20 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Creating image(s)
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Ensure instance console log exists: /opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Start _get_guest_xml network_info=[{"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fa4cca91-e2cf-4bed-8d99-5f9e6a298a9e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZxEswKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94a31275-2023-4fc1-a2ca-887a126972e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'd76b2786-396b-4b98-bf0b-9233b9d4b3cb', 'serial': 'd76b2786-396b-4b98-bf0b-9233b9d4b3cb'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': 'a2cc3972-7456-40da-bdb6-aac4d8718b5e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDbOYRdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94a31275-2023-4fc1-a2ca-887a126972e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5caa498-e3f9-497c-bae9-f2d0e27cbd22', 'serial': 'c5caa498-e3f9-497c-bae9-f2d0e27cbd22'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '01885e22-b954-4463-95fa-2dfb7f1fc5d0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFJaGnyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94a31275-2023-4fc1-a2ca-887a126972e8', 'attached_at': '', 'detached_at': '', 'volume_id': '0449deb8-a7b2-4f6b-a469-a8472837cfeb', 'serial': '0449deb8-a7b2-4f6b-a469-a8472837cfeb'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:00:20 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connector [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Factory for ISCSI on None {{(pid=72904) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZxEswKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:20 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:20 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:20 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5bc2b-c1c5-449b-b1bb-fe25b618b220]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:00:20 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79f5b82-89d5-4a23-b7e5-fe66df0919ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb] added
Aug 27 05:00:20 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cb64bf-64f4-4f2d-bd03-7a5209755d82]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e57d4-fcb1-4353-a8e8-8c5d74ebaaea]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZxEswKb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZxEswKb" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[682f8462-b262-455a-b0f4-7a6eee805919]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LZxEswKb'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f63cb20-649b-4bdc-bee2-210a01531186]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4a0339-e52a-420b-a98d-8a8b5ffaa4b1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:00:20 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:00:20 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:20 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:00:20 user nova-compute[72904]: 
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[163130d8-8e4e-4c27-96b0-acba864bd204]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260]
Aug 27 05:00:20 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260] successful.
Aug 27 05:00:20 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2e05f6-7735-40db-a65d-c7de2ba1b934]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c079434e-2102-45d7-b417-d32dfebfc7e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dfd2d1-84d1-41ae-94fc-a600ab3df85d]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZxEswKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "93251700-8080-409f-8867-556781572964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "93251700-8080-409f-8867-556781572964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:00:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7075MB free_disk=25.826969146728516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0324de51-3864-4a3b-bc2c-2046a9925275 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance cae1202f-0f6c-437e-8334-215b4736e061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 94a31275-2023-4fc1-a2ca-887a126972e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bd8444b2-1511-446b-8139-3809a4a12e5b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 93251700-8080-409f-8867-556781572964 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 72995227-dd52-4b04-a119-41c34dc2e43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 660b1c77-120e-40d5-b698-b89ec506caf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:00:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26463636563343133', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463636563343133', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDbOYRdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:22 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:22 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:22 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda27b04-9795-440e-84ed-981b2ccbfa6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:00:22 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd2ccd9-0286-4913-a9e7-eee038bbb394]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22] added
Aug 27 05:00:22 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c53fa41-ebd6-433f-add4-1f13fc9f85d8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe33cd74-7a9c-49b1-a9f6-ca1303a804a5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDbOYRdH {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDbOYRdH" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d0248c-1b05-47f8-a5ad-e96c323d6a2e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDbOYRdH'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0e3a3-daf3-45b0-ad5b-37484b969a7b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4795f53-1683-4af3-9ca5-4a52ed768bc8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.446s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:22 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:22 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:00:22 user nova-compute[72904]: INFO nova.compute.claims [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Claim successful on node user
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.objects.instance [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lazy-loading 'flavor' on Instance uuid 0324de51-3864-4a3b-bc2c-2046a9925275 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[001dfdc0-9ac6-43f3-b93e-f7d01ab83f50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260]
Aug 27 05:00:22 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260] successful.
Aug 27 05:00:22 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3578ff-b9b9-46ed-a720-90ae7f022af6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8132f1ee-49cb-43cd-abcf-3abbba64335b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:22 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:22 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:22 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:22 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[758c4c42-7bcb-4bb3-a023-d768d1cdd2f2]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDbOYRdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:22 user nova-compute[72904]: INFO nova.compute.manager [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Attaching volume 27a28a5f-f225-480b-8dab-ee9ed83dcaec to /dev/vdb
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.utils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed86f93-fef0-418f-8c38-14dfdede0052]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37ce740-a8d8-4090-86e7-eb072960608c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52c3afe-abfb-4cf2-ab57-56f6fdf1bd95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5065037b-1afa-48fc-b8f7-bfed3a6391af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:22 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[33445605-523e-4422-8030-4b8035aee04a]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG os_brick.utils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updating existing volume attachment record: 54ba50b3-fc21-499a-9900-543e1f892d15 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:00:22 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:00:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.policy [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcd62b49154b47d58be14586316fc1a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '639c2163be4446719e85d97984980e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:00:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Creating image(s)
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "/opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "/opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "/opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23838373134343035', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838373134343035', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFJaGnyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:23 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:23 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:23 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ca2f8-d191-49d4-b619-cb7d40f06e45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:00:23 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk 1073741824" returned: 0 in 0.050s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0044721d-3f79-45df-b813-e6e6910bdf6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb] added
Aug 27 05:00:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f5bfec-7780-45e7-a43d-fe5fee1d9d0f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ada8921-7e9f-4ae5-b80f-6d609b401a01]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFJaGnyN {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFJaGnyN" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ce324f-b397-4165-b9e9-017e62787e30]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rFJaGnyN'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70bcd2c-ceff-4e1b-8639-df8ee887c79c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79a96f-1c24-4143-abc8-2a76561acad5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:23 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:23 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Successfully created port: e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee5b6a7-af5d-47bd-8115-8128cb56125b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260]
Aug 27 05:00:23 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260] successful.
Aug 27 05:00:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[303b345f-20f1-47f6-b5f3-2aca3d3daa53]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436f2fa-e742-4735-a408-b4f1e3f664ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:23 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:23 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:23 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:23 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Cannot resize image /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Ensure instance console log exists: /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.040s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d208b7b-1201-478c-9b04-5ca280c70256]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:00:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFJaGnyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updating instance_info_cache with network_info: [{"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23763626533613034', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763626533613034', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:17:0f,bridge_name='br-int',has_traffic_filtering=True,id=6b4be91f-fec1-4711-bcd3-1508e3483b83,network=Network(e0320489-540b-4a05-8f03-acffe2e60359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4be91f-fe') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:cb:fa,bridge_name='br-int',has_traffic_filtering=True,id=d94829ae-2209-414c-970a-d61335d88a33,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd94829ae-22') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec18210c-eb48-42cb-9a7a-50e9a429e2ae,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec18210c-eb') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:5f,bridge_name='br-int',has_traffic_filtering=True,id=7022f918-bdc9-4834-8286-fc31b080657a,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7022f918-bd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:95:9a,bridge_name='br-int',has_traffic_filtering=True,id=08acb973-7a38-4315-aa2f-e9b33b5fed31,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb973-7a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:19:df,bridge_name='br-int',has_traffic_filtering=True,id=c7e99438-d7fe-4404-b0ad-265fe223e15f,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e99438-d7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=9cd1a40c-3234-440a-afb4-057da3c9bc56,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd1a40c-32') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.objects.instance [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a31275-2023-4fc1-a2ca-887a126972e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:00:24 user nova-compute[72904]:   <uuid>94a31275-2023-4fc1-a2ca-887a126972e8</uuid>
Aug 27 05:00:24 user nova-compute[72904]:   <name>instance-0000000a</name>
Aug 27 05:00:24 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:00:24 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:00:24 user nova-compute[72904]:   <metadata>
Aug 27 05:00:24 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:00:24 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:00:24 user nova-compute[72904]:       <nova:name>tempest-device-tagging-server-1582712173</nova:name>
Aug 27 05:00:24 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:00:20</nova:creationTime>
Aug 27 05:00:24 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:00:24 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:00:24 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:00:24 user nova-compute[72904]:       <nova:owner>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:user uuid="3eebf8c3b27c49feb6561c7c3af7b1a8">tempest-TaggedBootDevicesTest-37486034-project-member</nova:user>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:project uuid="3187574818a94f47aa4961397b84a79a">tempest-TaggedBootDevicesTest-37486034</nova:project>
Aug 27 05:00:24 user nova-compute[72904]:       </nova:owner>
Aug 27 05:00:24 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:00:24 user nova-compute[72904]:       <nova:ports>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:port uuid="6b4be91f-fec1-4711-bcd3-1508e3483b83">
Aug 27 05:00:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:00:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:port uuid="d94829ae-2209-414c-970a-d61335d88a33">
Aug 27 05:00:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.218" ipVersion="4"/>
Aug 27 05:00:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:port uuid="ec18210c-eb48-42cb-9a7a-50e9a429e2ae">
Aug 27 05:00:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Aug 27 05:00:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:port uuid="7022f918-bdc9-4834-8286-fc31b080657a">
Aug 27 05:00:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.174" ipVersion="4"/>
Aug 27 05:00:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:port uuid="08acb973-7a38-4315-aa2f-e9b33b5fed31">
Aug 27 05:00:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Aug 27 05:00:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:port uuid="c7e99438-d7fe-4404-b0ad-265fe223e15f">
Aug 27 05:00:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 05:00:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:24 user nova-compute[72904]:         <nova:port uuid="9cd1a40c-3234-440a-afb4-057da3c9bc56">
Aug 27 05:00:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 05:00:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:24 user nova-compute[72904]:       </nova:ports>
Aug 27 05:00:24 user nova-compute[72904]:     </nova:instance>
Aug 27 05:00:24 user nova-compute[72904]:   </metadata>
Aug 27 05:00:24 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:00:24 user nova-compute[72904]:     <system>
Aug 27 05:00:24 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:00:24 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:00:24 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:00:24 user nova-compute[72904]:       <entry name="serial">94a31275-2023-4fc1-a2ca-887a126972e8</entry>
Aug 27 05:00:24 user nova-compute[72904]:       <entry name="uuid">94a31275-2023-4fc1-a2ca-887a126972e8</entry>
Aug 27 05:00:24 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:00:24 user nova-compute[72904]:     </system>
Aug 27 05:00:24 user nova-compute[72904]:   </sysinfo>
Aug 27 05:00:24 user nova-compute[72904]:   <os>
Aug 27 05:00:24 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:00:24 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:00:24 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:00:24 user nova-compute[72904]:   </os>
Aug 27 05:00:24 user nova-compute[72904]:   <features>
Aug 27 05:00:24 user nova-compute[72904]:     <acpi/>
Aug 27 05:00:24 user nova-compute[72904]:     <apic/>
Aug 27 05:00:24 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:00:24 user nova-compute[72904]:   </features>
Aug 27 05:00:24 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:00:24 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:00:24 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:00:24 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:00:24 user nova-compute[72904]:   </clock>
Aug 27 05:00:24 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:00:24 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:00:24 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:00:24 user nova-compute[72904]:   </cpu>
Aug 27 05:00:24 user nova-compute[72904]:   <devices>
Aug 27 05:00:24 user nova-compute[72904]:     <disk type="file" device="cdrom">
Aug 27 05:00:24 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 05:00:24 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8/disk.config"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="hda" bus="ide"/>
Aug 27 05:00:24 user nova-compute[72904]:     </disk>
Aug 27 05:00:24 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:00:24 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:00:24 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <serial>d76b2786-396b-4b98-bf0b-9233b9d4b3cb</serial>
Aug 27 05:00:24 user nova-compute[72904]:     </disk>
Aug 27 05:00:24 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:00:24 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:00:24 user nova-compute[72904]:       <source dev="/dev/sdc"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <serial>c5caa498-e3f9-497c-bae9-f2d0e27cbd22</serial>
Aug 27 05:00:24 user nova-compute[72904]:     </disk>
Aug 27 05:00:24 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:00:24 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:00:24 user nova-compute[72904]:       <source dev="/dev/sdd"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="vdc" bus="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <serial>0449deb8-a7b2-4f6b-a469-a8472837cfeb</serial>
Aug 27 05:00:24 user nova-compute[72904]:     </disk>
Aug 27 05:00:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:24 user nova-compute[72904]:       <mac address="fa:16:3e:6c:17:0f"/>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="tap6b4be91f-fe"/>
Aug 27 05:00:24 user nova-compute[72904]:     </interface>
Aug 27 05:00:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:24 user nova-compute[72904]:       <mac address="fa:16:3e:66:cb:fa"/>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="tapd94829ae-22"/>
Aug 27 05:00:24 user nova-compute[72904]:     </interface>
Aug 27 05:00:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:24 user nova-compute[72904]:       <mac address="fa:16:3e:74:c5:b7"/>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="tapec18210c-eb"/>
Aug 27 05:00:24 user nova-compute[72904]:     </interface>
Aug 27 05:00:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:24 user nova-compute[72904]:       <mac address="fa:16:3e:62:b4:5f"/>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="tap7022f918-bd"/>
Aug 27 05:00:24 user nova-compute[72904]:     </interface>
Aug 27 05:00:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:24 user nova-compute[72904]:       <mac address="fa:16:3e:cf:95:9a"/>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="tap08acb973-7a"/>
Aug 27 05:00:24 user nova-compute[72904]:     </interface>
Aug 27 05:00:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:24 user nova-compute[72904]:       <mac address="fa:16:3e:f9:19:df"/>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="tapc7e99438-d7"/>
Aug 27 05:00:24 user nova-compute[72904]:     </interface>
Aug 27 05:00:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:24 user nova-compute[72904]:       <mac address="fa:16:3e:b8:c5:36"/>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:24 user nova-compute[72904]:       <target dev="tap9cd1a40c-32"/>
Aug 27 05:00:24 user nova-compute[72904]:     </interface>
Aug 27 05:00:24 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:00:24 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8/console.log" append="off"/>
Aug 27 05:00:24 user nova-compute[72904]:     </serial>
Aug 27 05:00:24 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:00:24 user nova-compute[72904]:     <video>
Aug 27 05:00:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:24 user nova-compute[72904]:     </video>
Aug 27 05:00:24 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:00:24 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:00:24 user nova-compute[72904]:     </rng>
Aug 27 05:00:24 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:00:24 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:00:24 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:00:24 user nova-compute[72904]:     </memballoon>
Aug 27 05:00:24 user nova-compute[72904]:   </devices>
Aug 27 05:00:24 user nova-compute[72904]: </domain>
Aug 27 05:00:24 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:17:0f,bridge_name='br-int',has_traffic_filtering=True,id=6b4be91f-fec1-4711-bcd3-1508e3483b83,network=Network(e0320489-540b-4a05-8f03-acffe2e60359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4be91f-fe') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:17:0f,bridge_name='br-int',has_traffic_filtering=True,id=6b4be91f-fec1-4711-bcd3-1508e3483b83,network=Network(e0320489-540b-4a05-8f03-acffe2e60359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4be91f-fe') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Successfully updated port: e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b4be91f-fe, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b4be91f-fe, col_values=(('external_ids', {'iface-id': '6b4be91f-fec1-4711-bcd3-1508e3483b83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:17:0f', 'vm-uuid': '94a31275-2023-4fc1-a2ca-887a126972e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "refresh_cache-93251700-8080-409f-8867-556781572964" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquired lock "refresh_cache-93251700-8080-409f-8867-556781572964" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:17:0f,bridge_name='br-int',has_traffic_filtering=True,id=6b4be91f-fec1-4711-bcd3-1508e3483b83,network=Network(e0320489-540b-4a05-8f03-acffe2e60359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4be91f-fe')
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:cb:fa,bridge_name='br-int',has_traffic_filtering=True,id=d94829ae-2209-414c-970a-d61335d88a33,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd94829ae-22') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:cb:fa,bridge_name='br-int',has_traffic_filtering=True,id=d94829ae-2209-414c-970a-d61335d88a33,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd94829ae-22') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd94829ae-22, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd94829ae-22, col_values=(('external_ids', {'iface-id': 'd94829ae-2209-414c-970a-d61335d88a33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:cb:fa', 'vm-uuid': '94a31275-2023-4fc1-a2ca-887a126972e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] [instance: 93251700-8080-409f-8867-556781572964] Received event network-changed-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] [instance: 93251700-8080-409f-8867-556781572964] Refreshing instance network info cache due to event network-changed-e02e7f98-7145-4cf7-be99-776132b0cab1. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] Acquiring lock "refresh_cache-93251700-8080-409f-8867-556781572964" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:cb:fa,bridge_name='br-int',has_traffic_filtering=True,id=d94829ae-2209-414c-970a-d61335d88a33,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd94829ae-22')
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec18210c-eb48-42cb-9a7a-50e9a429e2ae,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec18210c-eb') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec18210c-eb48-42cb-9a7a-50e9a429e2ae,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec18210c-eb') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec18210c-eb, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec18210c-eb, col_values=(('external_ids', {'iface-id': 'ec18210c-eb48-42cb-9a7a-50e9a429e2ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c5:b7', 'vm-uuid': '94a31275-2023-4fc1-a2ca-887a126972e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec18210c-eb48-42cb-9a7a-50e9a429e2ae,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec18210c-eb')
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:5f,bridge_name='br-int',has_traffic_filtering=True,id=7022f918-bdc9-4834-8286-fc31b080657a,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7022f918-bd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:5f,bridge_name='br-int',has_traffic_filtering=True,id=7022f918-bdc9-4834-8286-fc31b080657a,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7022f918-bd') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7022f918-bd, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7022f918-bd, col_values=(('external_ids', {'iface-id': '7022f918-bdc9-4834-8286-fc31b080657a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:b4:5f', 'vm-uuid': '94a31275-2023-4fc1-a2ca-887a126972e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:5f,bridge_name='br-int',has_traffic_filtering=True,id=7022f918-bdc9-4834-8286-fc31b080657a,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7022f918-bd')
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:95:9a,bridge_name='br-int',has_traffic_filtering=True,id=08acb973-7a38-4315-aa2f-e9b33b5fed31,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb973-7a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:95:9a,bridge_name='br-int',has_traffic_filtering=True,id=08acb973-7a38-4315-aa2f-e9b33b5fed31,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb973-7a') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08acb973-7a, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08acb973-7a, col_values=(('external_ids', {'iface-id': '08acb973-7a38-4315-aa2f-e9b33b5fed31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:95:9a', 'vm-uuid': '94a31275-2023-4fc1-a2ca-887a126972e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:95:9a,bridge_name='br-int',has_traffic_filtering=True,id=08acb973-7a38-4315-aa2f-e9b33b5fed31,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb973-7a')
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:19:df,bridge_name='br-int',has_traffic_filtering=True,id=c7e99438-d7fe-4404-b0ad-265fe223e15f,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e99438-d7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:19:df,bridge_name='br-int',has_traffic_filtering=True,id=c7e99438-d7fe-4404-b0ad-265fe223e15f,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e99438-d7') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7e99438-d7, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7e99438-d7, col_values=(('external_ids', {'iface-id': 'c7e99438-d7fe-4404-b0ad-265fe223e15f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:19:df', 'vm-uuid': '94a31275-2023-4fc1-a2ca-887a126972e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:19:df,bridge_name='br-int',has_traffic_filtering=True,id=c7e99438-d7fe-4404-b0ad-265fe223e15f,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e99438-d7')
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=9cd1a40c-3234-440a-afb4-057da3c9bc56,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd1a40c-32') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=9cd1a40c-3234-440a-afb4-057da3c9bc56,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd1a40c-32') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cd1a40c-32, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cd1a40c-32, col_values=(('external_ids', {'iface-id': '9cd1a40c-3234-440a-afb4-057da3c9bc56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:c5:36', 'vm-uuid': '94a31275-2023-4fc1-a2ca-887a126972e8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Updating instance_info_cache with network_info: [{"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Releasing lock "refresh_cache-93251700-8080-409f-8867-556781572964" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Instance network_info: |[{"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] Acquired lock "refresh_cache-93251700-8080-409f-8867-556781572964" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] [instance: 93251700-8080-409f-8867-556781572964] Refreshing network info cache for port e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Start _get_guest_xml network_info=[{"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=9cd1a40c-3234-440a-afb4-057da3c9bc56,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd1a40c-32')
Aug 27 05:00:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:00:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-209348806',display_name='tempest-ServersNegativeTestJSON-server-209348806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-209348806',id=12,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='639c2163be4446719e85d97984980e7f',ramdisk_id='',reservation_id='r-dt8nggxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1301649002',owner_user_name='tempest-ServersNegativeTestJSON-1301649002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:23Z,user_data=None,user_id='fcd62b49154b47d58be14586316fc1a3',uuid=93251700-8080-409f-8867-556781572964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converting VIF {"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:77,bridge_name='br-int',has_traffic_filtering=True,id=e02e7f98-7145-4cf7-be99-776132b0cab1,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02e7f98-71') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lazy-loading 'pci_devices' on Instance uuid 93251700-8080-409f-8867-556781572964 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:00:25 user nova-compute[72904]:   <uuid>93251700-8080-409f-8867-556781572964</uuid>
Aug 27 05:00:25 user nova-compute[72904]:   <name>instance-0000000c</name>
Aug 27 05:00:25 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:00:25 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:00:25 user nova-compute[72904]:   <metadata>
Aug 27 05:00:25 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:00:25 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:00:25 user nova-compute[72904]:       <nova:name>tempest-ServersNegativeTestJSON-server-209348806</nova:name>
Aug 27 05:00:25 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:00:25</nova:creationTime>
Aug 27 05:00:25 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:00:25 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:00:25 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:00:25 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:00:25 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:00:25 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:00:25 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:00:25 user nova-compute[72904]:       <nova:owner>
Aug 27 05:00:25 user nova-compute[72904]:         <nova:user uuid="fcd62b49154b47d58be14586316fc1a3">tempest-ServersNegativeTestJSON-1301649002-project-member</nova:user>
Aug 27 05:00:25 user nova-compute[72904]:         <nova:project uuid="639c2163be4446719e85d97984980e7f">tempest-ServersNegativeTestJSON-1301649002</nova:project>
Aug 27 05:00:25 user nova-compute[72904]:       </nova:owner>
Aug 27 05:00:25 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:00:25 user nova-compute[72904]:       <nova:ports>
Aug 27 05:00:25 user nova-compute[72904]:         <nova:port uuid="e02e7f98-7145-4cf7-be99-776132b0cab1">
Aug 27 05:00:25 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 05:00:25 user nova-compute[72904]:         </nova:port>
Aug 27 05:00:25 user nova-compute[72904]:       </nova:ports>
Aug 27 05:00:25 user nova-compute[72904]:     </nova:instance>
Aug 27 05:00:25 user nova-compute[72904]:   </metadata>
Aug 27 05:00:25 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:00:25 user nova-compute[72904]:     <system>
Aug 27 05:00:25 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:00:25 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:00:25 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:00:25 user nova-compute[72904]:       <entry name="serial">93251700-8080-409f-8867-556781572964</entry>
Aug 27 05:00:25 user nova-compute[72904]:       <entry name="uuid">93251700-8080-409f-8867-556781572964</entry>
Aug 27 05:00:25 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:00:25 user nova-compute[72904]:     </system>
Aug 27 05:00:25 user nova-compute[72904]:   </sysinfo>
Aug 27 05:00:25 user nova-compute[72904]:   <os>
Aug 27 05:00:25 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:00:25 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:00:25 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:00:25 user nova-compute[72904]:   </os>
Aug 27 05:00:25 user nova-compute[72904]:   <features>
Aug 27 05:00:25 user nova-compute[72904]:     <acpi/>
Aug 27 05:00:25 user nova-compute[72904]:     <apic/>
Aug 27 05:00:25 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:00:25 user nova-compute[72904]:   </features>
Aug 27 05:00:25 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:00:25 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:00:25 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:00:25 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:00:25 user nova-compute[72904]:   </clock>
Aug 27 05:00:25 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:00:25 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:00:25 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:00:25 user nova-compute[72904]:   </cpu>
Aug 27 05:00:25 user nova-compute[72904]:   <devices>
Aug 27 05:00:25 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:00:25 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:00:25 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk"/>
Aug 27 05:00:25 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:00:25 user nova-compute[72904]:     </disk>
Aug 27 05:00:25 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:00:25 user nova-compute[72904]:       <mac address="fa:16:3e:8e:ed:77"/>
Aug 27 05:00:25 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:25 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:00:25 user nova-compute[72904]:       <target dev="tape02e7f98-71"/>
Aug 27 05:00:25 user nova-compute[72904]:     </interface>
Aug 27 05:00:25 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:00:25 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/console.log" append="off"/>
Aug 27 05:00:25 user nova-compute[72904]:     </serial>
Aug 27 05:00:25 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:00:25 user nova-compute[72904]:     <video>
Aug 27 05:00:25 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:00:25 user nova-compute[72904]:     </video>
Aug 27 05:00:25 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:00:25 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:00:25 user nova-compute[72904]:     </rng>
Aug 27 05:00:25 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:00:25 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:00:25 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:00:25 user nova-compute[72904]:     </memballoon>
Aug 27 05:00:25 user nova-compute[72904]:   </devices>
Aug 27 05:00:25 user nova-compute[72904]: </domain>
Aug 27 05:00:25 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-209348806',display_name='tempest-ServersNegativeTestJSON-server-209348806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-209348806',id=12,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='639c2163be4446719e85d97984980e7f',ramdisk_id='',reservation_id='r-dt8nggxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1301649002',owner_user_name='tempest-ServersNegativeTestJSON-1301649002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:23Z,user_data=None,user_id='fcd62b49154b47d58be14586316fc1a3',uuid=93251700-8080-409f-8867-556781572964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converting VIF {"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:77,bridge_name='br-int',has_traffic_filtering=True,id=e02e7f98-7145-4cf7-be99-776132b0cab1,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02e7f98-71') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG os_vif [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:77,bridge_name='br-int',has_traffic_filtering=True,id=e02e7f98-7145-4cf7-be99-776132b0cab1,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02e7f98-71') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape02e7f98-71, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape02e7f98-71, col_values=(('external_ids', {'iface-id': 'e02e7f98-7145-4cf7-be99-776132b0cab1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:ed:77', 'vm-uuid': '93251700-8080-409f-8867-556781572964'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] No BDM found with device name hda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] No VIF found with MAC fa:16:3e:6c:17:0f, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] No VIF found with MAC fa:16:3e:cf:95:9a, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:00:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Using config drive
Aug 27 05:00:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:25 user nova-compute[72904]: INFO os_vif [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:77,bridge_name='br-int',has_traffic_filtering=True,id=e02e7f98-7145-4cf7-be99-776132b0cab1,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02e7f98-71')
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] No VIF found with MAC fa:16:3e:8e:ed:77, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:00:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Creating config drive at /opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8/disk.config
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx77amg4b {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx77amg4b" returned: 0 in 0.064s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] [instance: 93251700-8080-409f-8867-556781572964] Updated VIF entry in instance network info cache for port e02e7f98-7145-4cf7-be99-776132b0cab1. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] [instance: 93251700-8080-409f-8867-556781572964] Updating instance_info_cache with network_info: [{"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e93f269b-3f78-4e27-b111-03a58aeeafc0 req-7e78c535-5834-49af-9eef-b3dec6f3fea4 service nova] Releasing lock "refresh_cache-93251700-8080-409f-8867-556781572964" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing instance network info cache due to event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:27 user nova-compute[72904]: DEBUG nova.network.neutron [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updated VIF entry in instance network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:27 user nova-compute[72904]: DEBUG nova.network.neutron [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-91623cbd-cc85-4373-8b60-ce8d580c0278 req-892680e2-cf6c-43fc-a5b0-40b9f43eb8c0 service nova] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: INFO nova.virt.block_device [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Booting with volume 91950a7d-c9fe-4606-b4ff-dd8f2cb31755 at /dev/vdb
Aug 27 05:00:28 user nova-compute[72904]: DEBUG os_brick.utils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b47f16c-0b3b-441f-a8b5-772f29640d39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f672c7d-7500-4c66-8b46-190ae7f73bda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e0b4cd-14f7-47a4-a84b-fdee9f1beb40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c994145d-5dc6-43f7-a6b3-2aa3d6eab02d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-f93c9876-8615-443e-beac-d59f1fb2359d req-7dd01198-643a-4fc8-951b-4a2020403fd1 service nova] [instance: 93251700-8080-409f-8867-556781572964] Received event network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f93c9876-8615-443e-beac-d59f1fb2359d req-7dd01198-643a-4fc8-951b-4a2020403fd1 service nova] Acquiring lock "93251700-8080-409f-8867-556781572964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f93c9876-8615-443e-beac-d59f1fb2359d req-7dd01198-643a-4fc8-951b-4a2020403fd1 service nova] Lock "93251700-8080-409f-8867-556781572964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f93c9876-8615-443e-beac-d59f1fb2359d req-7dd01198-643a-4fc8-951b-4a2020403fd1 service nova] Lock "93251700-8080-409f-8867-556781572964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-f93c9876-8615-443e-beac-d59f1fb2359d req-7dd01198-643a-4fc8-951b-4a2020403fd1 service nova] [instance: 93251700-8080-409f-8867-556781572964] No waiting events found dispatching network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:28 user nova-compute[72904]: WARNING nova.compute.manager [req-f93c9876-8615-443e-beac-d59f1fb2359d req-7dd01198-643a-4fc8-951b-4a2020403fd1 service nova] [instance: 93251700-8080-409f-8867-556781572964] Received unexpected event network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 for instance with vm_state building and task_state spawning.
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:28 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee59c215-c699-4f2d-9f7c-55911b7e1718]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG os_brick.utils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating existing volume attachment record: 4bf1a51f-ed5d-4090-8b9a-b92a1bfa2de2 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:28 user nova-compute[72904]: INFO nova.compute.manager [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] instance snapshotting
Aug 27 05:00:28 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Beginning live snapshot process
Aug 27 05:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-changed-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Refreshing instance network info cache due to event network-changed-f4285663-09bc-421f-9017-4c18cf096612. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:28 user nova-compute[72904]: DEBUG nova.network.neutron [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Refreshing network info cache for port f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json -f qcow2" returned: 0 in 0.221s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json -f qcow2" returned: 0 in 0.222s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updated VIF entry in instance network info cache for port f4285663-09bc-421f-9017-4c18cf096612. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:29 user nova-compute[72904]: WARNING nova.compute.manager [req-5d3a094a-c20f-40e4-9050-39de6ad12022 req-ea7e7dec-9679-4b60-a8d3-b66dca656cf1 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 for instance with vm_state building and task_state spawning.
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.248s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzxc0by38/ee66ba5426654a72a6bda7b91fc8117e.delta 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzxc0by38/ee66ba5426654a72a6bda7b91fc8117e.delta 1073741824" returned: 0 in 0.058s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 05:00:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72904) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 27 05:00:29 user nova-compute[72904]: INFO nova.virt.libvirt.host [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] UEFI support detected
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-f23eac54-4fa8-475b-b07a-445a7dc0b537 req-65cc3443-d33a-4b5c-8f30-66be2016a4e7 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f23eac54-4fa8-475b-b07a-445a7dc0b537 req-65cc3443-d33a-4b5c-8f30-66be2016a4e7 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f23eac54-4fa8-475b-b07a-445a7dc0b537 req-65cc3443-d33a-4b5c-8f30-66be2016a4e7 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f23eac54-4fa8-475b-b07a-445a7dc0b537 req-65cc3443-d33a-4b5c-8f30-66be2016a4e7 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-f23eac54-4fa8-475b-b07a-445a7dc0b537 req-65cc3443-d33a-4b5c-8f30-66be2016a4e7 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:30 user nova-compute[72904]: WARNING nova.compute.manager [req-f23eac54-4fa8-475b-b07a-445a7dc0b537 req-65cc3443-d33a-4b5c-8f30-66be2016a4e7 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 for instance with vm_state building and task_state spawning.
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 93251700-8080-409f-8867-556781572964] Received event network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Acquiring lock "93251700-8080-409f-8867-556781572964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Lock "93251700-8080-409f-8867-556781572964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Lock "93251700-8080-409f-8867-556781572964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 93251700-8080-409f-8867-556781572964] No waiting events found dispatching network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:30 user nova-compute[72904]: WARNING nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 93251700-8080-409f-8867-556781572964] Received unexpected event network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 for instance with vm_state building and task_state spawning.
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:30 user nova-compute[72904]: WARNING nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 for instance with vm_state building and task_state spawning.
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:30 user nova-compute[72904]: WARNING nova.compute.manager [req-eb78f998-ee81-41d1-8769-21fd75fc4ec0 req-b8cbc90a-1df1-484d-a80a-6baf71278a78 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 for instance with vm_state building and task_state spawning.
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:31 user nova-compute[72904]: WARNING nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 for instance with vm_state building and task_state spawning.
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:31 user nova-compute[72904]: WARNING nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae for instance with vm_state building and task_state spawning.
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:31 user nova-compute[72904]: WARNING nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae for instance with vm_state building and task_state spawning.
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:31 user nova-compute[72904]: WARNING nova.compute.manager [req-b181475f-9cc6-44dd-b0fc-eb1cab111d07 req-8bae22ca-6db3-4153-8325-1bd029a47cfd service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a for instance with vm_state building and task_state spawning.
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:00:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzxc0by38/ee66ba5426654a72a6bda7b91fc8117e.delta /opt/stack/data/nova/instances/snapshots/tmpzxc0by38/ee66ba5426654a72a6bda7b91fc8117e {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-727afd77-737c-4f9c-a48e-4ea989d1b563 req-1f5b6df5-0231-4d95-b3d2-bc4782132535 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-727afd77-737c-4f9c-a48e-4ea989d1b563 req-1f5b6df5-0231-4d95-b3d2-bc4782132535 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-727afd77-737c-4f9c-a48e-4ea989d1b563 req-1f5b6df5-0231-4d95-b3d2-bc4782132535 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-727afd77-737c-4f9c-a48e-4ea989d1b563 req-1f5b6df5-0231-4d95-b3d2-bc4782132535 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-727afd77-737c-4f9c-a48e-4ea989d1b563 req-1f5b6df5-0231-4d95-b3d2-bc4782132535 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:32 user nova-compute[72904]: WARNING nova.compute.manager [req-727afd77-737c-4f9c-a48e-4ea989d1b563 req-1f5b6df5-0231-4d95-b3d2-bc4782132535 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 for instance with vm_state building and task_state spawning.
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112432.4584494, 93251700-8080-409f-8867-556781572964 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] VM Resumed (Lifecycle Event)
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzxc0by38/ee66ba5426654a72a6bda7b91fc8117e.delta /opt/stack/data/nova/instances/snapshots/tmpzxc0by38/ee66ba5426654a72a6bda7b91fc8117e" returned: 0 in 0.828s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Snapshot extracted, beginning image upload
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 93251700-8080-409f-8867-556781572964] Instance spawned successfully.
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-c8c179aa-cadd-4891-a5df-c4e066b32f95 req-f26d7856-6182-4342-ae46-4f38c64d0d47 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c8c179aa-cadd-4891-a5df-c4e066b32f95 req-f26d7856-6182-4342-ae46-4f38c64d0d47 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c8c179aa-cadd-4891-a5df-c4e066b32f95 req-f26d7856-6182-4342-ae46-4f38c64d0d47 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c8c179aa-cadd-4891-a5df-c4e066b32f95 req-f26d7856-6182-4342-ae46-4f38c64d0d47 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-c8c179aa-cadd-4891-a5df-c4e066b32f95 req-f26d7856-6182-4342-ae46-4f38c64d0d47 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:32 user nova-compute[72904]: WARNING nova.compute.manager [req-c8c179aa-cadd-4891-a5df-c4e066b32f95 req-f26d7856-6182-4342-ae46-4f38c64d0d47 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f for instance with vm_state building and task_state spawning.
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112432.4589727, 93251700-8080-409f-8867-556781572964 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] VM Started (Lifecycle Event)
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 93251700-8080-409f-8867-556781572964] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Took 9.58 seconds to spawn the instance on the hypervisor.
Aug 27 05:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:32 user nova-compute[72904]: INFO nova.compute.manager [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Took 10.98 seconds to build instance.
Aug 27 05:00:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a84f1baf-6f5f-4dde-8894-03fe05ee2b5a tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "93251700-8080-409f-8867-556781572964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.071s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-537478aa-92c1-49b0-b060-791ca15c7a93 req-2bfd24cf-ec29-4c63-8f55-c2a3000e98d2 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-537478aa-92c1-49b0-b060-791ca15c7a93 req-2bfd24cf-ec29-4c63-8f55-c2a3000e98d2 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-537478aa-92c1-49b0-b060-791ca15c7a93 req-2bfd24cf-ec29-4c63-8f55-c2a3000e98d2 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-537478aa-92c1-49b0-b060-791ca15c7a93 req-2bfd24cf-ec29-4c63-8f55-c2a3000e98d2 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-537478aa-92c1-49b0-b060-791ca15c7a93 req-2bfd24cf-ec29-4c63-8f55-c2a3000e98d2 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:33 user nova-compute[72904]: WARNING nova.compute.manager [req-537478aa-92c1-49b0-b060-791ca15c7a93 req-2bfd24cf-ec29-4c63-8f55-c2a3000e98d2 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a for instance with vm_state building and task_state spawning.
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112434.3058677, 94a31275-2023-4fc1-a2ca-887a126972e8 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:00:34 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] VM Resumed (Lifecycle Event)
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:00:34 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance spawned successfully.
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:00:34 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112434.309113, 94a31275-2023-4fc1-a2ca-887a126972e8 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:00:34 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] VM Started (Lifecycle Event)
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:00:34 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:00:34 user nova-compute[72904]: INFO nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Took 13.85 seconds to spawn the instance on the hypervisor.
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:34 user nova-compute[72904]: INFO nova.compute.manager [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Took 52.77 seconds to build instance.
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ea306c5-2c3b-4181-978e-4db7cf0ca3cc tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "94a31275-2023-4fc1-a2ca-887a126972e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.866s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:34 user nova-compute[72904]: WARNING nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f for instance with vm_state active and task_state None.
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:34 user nova-compute[72904]: WARNING nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 for instance with vm_state active and task_state None.
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:34 user nova-compute[72904]: WARNING nova.compute.manager [req-3b0fe2e0-fab5-4d4f-93a0-3a6823ca32e0 req-e89e2c8f-ab59-426c-a1f5-f879e1e7ce6e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 for instance with vm_state active and task_state None.
Aug 27 05:00:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Snapshot image upload complete
Aug 27 05:00:35 user nova-compute[72904]: INFO nova.compute.manager [None req-edb8f09e-e7c0-4404-83cd-98d6bdadf5cd tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Took 6.85 seconds to snapshot the instance on the hypervisor.
Aug 27 05:00:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AujflRnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:36 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:36 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:36 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec9520-c56c-4318-8526-25733a92a404]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:00:36 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c13759-a18c-4a76-9e9f-de780e02b0f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec] added
Aug 27 05:00:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[37432eb3-b072-48fc-a65b-2436f2fb560e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86e2a5e-c71c-458b-bb45-67103f4c68c6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AujflRnE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AujflRnE" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f50c9e7-09ae-4825-8945-e2c7390b3c71]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AujflRnE'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb7ca9b-f49d-4b26-9c02-84bb52c65ec0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda84005-7e6b-4d63-83cf-e08cbe5afd76]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c8410-ebd6-444c-9be8-a25c141c4ef4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260]
Aug 27 05:00:36 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260] successful.
Aug 27 05:00:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f41f0a1-17b0-4815-bd67-033681ace5ee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cef8e3-85f1-4ca0-876f-44bbf9158850]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec (non-flash)
Aug 27 05:00:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:36 user nova-compute[72904]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec (non-flash)
Aug 27 05:00:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e510382-947d-4d05-a7c5-f8d6647eb784]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:00:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AujflRnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:00:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26163363437613561', 'path': '/dev/sde'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163363437613561', 'path': '/dev/sde'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:00:37 user nova-compute[72904]: DEBUG nova.objects.instance [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lazy-loading 'flavor' on Instance uuid 0324de51-3864-4a3b-bc2c-2046a9925275 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:00:38 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:00:38 user nova-compute[72904]:   <source dev="/dev/sde"/>
Aug 27 05:00:38 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:00:38 user nova-compute[72904]:   <serial>27a28a5f-f225-480b-8dab-ee9ed83dcaec</serial>
Aug 27 05:00:38 user nova-compute[72904]: </disk>
Aug 27 05:00:38 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:00:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:00:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:00:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] No VIF found with MAC fa:16:3e:9c:1b:9c, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:00:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-690c01e3-a64a-4c62-97dc-256fcfed1b4a tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.042s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:39 user nova-compute[72904]: INFO nova.compute.manager [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Terminating instance
Aug 27 05:00:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-e885888b-2656-48c7-909c-e4fef45a8dcf req-55a0e71e-2fb5-4afe-963a-175a2b3968ee service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received event network-vif-unplugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e885888b-2656-48c7-909c-e4fef45a8dcf req-55a0e71e-2fb5-4afe-963a-175a2b3968ee service nova] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e885888b-2656-48c7-909c-e4fef45a8dcf req-55a0e71e-2fb5-4afe-963a-175a2b3968ee service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e885888b-2656-48c7-909c-e4fef45a8dcf req-55a0e71e-2fb5-4afe-963a-175a2b3968ee service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-e885888b-2656-48c7-909c-e4fef45a8dcf req-55a0e71e-2fb5-4afe-963a-175a2b3968ee service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] No waiting events found dispatching network-vif-unplugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-e885888b-2656-48c7-909c-e4fef45a8dcf req-55a0e71e-2fb5-4afe-963a-175a2b3968ee service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received event network-vif-unplugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:00:40 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Instance destroyed successfully.
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lazy-loading 'resources' on Instance uuid 0324de51-3864-4a3b-bc2c-2046a9925275 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1562583159',display_name='tempest-DeleteServersTestJSON-server-1562583159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1562583159',id=1,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:58:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cd8319024834ebb869d5123bf29f6e7',ramdisk_id='',reservation_id='r-afye7y5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1381558065',owner_user_name='tempest-DeleteServersTestJSON-1381558065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:58:37Z,user_data=None,user_id='21e26f0938734629ac95abace6d0035d',uuid=0324de51-3864-4a3b-bc2c-2046a9925275,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Converting VIF {"id": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "address": "fa:16:3e:9c:1b:9c", "network": {"id": "97aa35d9-2849-4f12-99d8-0b6603879c1b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1066835392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cd8319024834ebb869d5123bf29f6e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fb311a0-3c", "ovs_interfaceid": "9fb311a0-3c71-4174-9b3e-cf768cd5aa89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:1b:9c,bridge_name='br-int',has_traffic_filtering=True,id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89,network=Network(97aa35d9-2849-4f12-99d8-0b6603879c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb311a0-3c') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_vif [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:1b:9c,bridge_name='br-int',has_traffic_filtering=True,id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89,network=Network(97aa35d9-2849-4f12-99d8-0b6603879c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb311a0-3c') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fb311a0-3c, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:40 user nova-compute[72904]: INFO os_vif [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:1b:9c,bridge_name='br-int',has_traffic_filtering=True,id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89,network=Network(97aa35d9-2849-4f12-99d8-0b6603879c1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fb311a0-3c')
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AujflRnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:40 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348c7c7-c4d6-4f98-907a-c1d23cf4cd0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ed1d7-70e8-48e3-843f-818b38fe6a6c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:40 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:40 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:40 user nova-compute[72904]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec (non-flash)
Aug 27 05:00:40 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:00:40 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:00:40 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:00:40 user nova-compute[72904]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec (non-flash)
Aug 27 05:00:40 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f918c3197e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec'): ({'sde'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Removing single pathed devices sde {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cc362c-c33a-4ab9-8cee-b5c374f0c8d9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac6f54-0db3-4b18-98c7-f02068a49913]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Flushing IO for device /dev/sde {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b96d66-f5b6-4a35-aea1-877b7680b9ee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39bc1db-07b7-4b3d-9bc2-2d51eb18773f]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e547107-1401-41c4-b7af-a0f7e851710b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[67262f74-8816-4722-883e-490e0ea920ca]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260]
Aug 27 05:00:40 user nova-compute[72904]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec, portal: 172.16.0.220,3260] successful.
Aug 27 05:00:40 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a28a5f-f225-480b-8dab-ee9ed83dcaec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7647b2-f175-42f4-b969-e75d8991afe5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] <== disconnect_volume: return (351ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:00:40 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Deleting instance files /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275_del
Aug 27 05:00:40 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Deletion of /opt/stack/data/nova/instances/0324de51-3864-4a3b-bc2c-2046a9925275_del complete
Aug 27 05:00:40 user nova-compute[72904]: INFO nova.compute.manager [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 27 05:00:40 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:00:40 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:00:41 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:41 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Took 0.80 seconds to deallocate network for instance.
Aug 27 05:00:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-420a40c6-8d06-4b1f-bcdd-6b1b1158ccd6 req-8b513256-442c-4328-9559-c7408d6caf28 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received event network-vif-deleted-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:41 user nova-compute[72904]: INFO nova.compute.manager [req-420a40c6-8d06-4b1f-bcdd-6b1b1158ccd6 req-8b513256-442c-4328-9559-c7408d6caf28 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Neutron deleted interface 9fb311a0-3c71-4174-9b3e-cf768cd5aa89; detaching it from the instance and deleting it from the info cache
Aug 27 05:00:41 user nova-compute[72904]: DEBUG nova.network.neutron [req-420a40c6-8d06-4b1f-bcdd-6b1b1158ccd6 req-8b513256-442c-4328-9559-c7408d6caf28 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-420a40c6-8d06-4b1f-bcdd-6b1b1158ccd6 req-8b513256-442c-4328-9559-c7408d6caf28 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Detach interface failed, port_id=9fb311a0-3c71-4174-9b3e-cf768cd5aa89, reason: Instance 0324de51-3864-4a3b-bc2c-2046a9925275 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:00:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-dd7d1245-12a4-4d3c-b975-d08c92c0a5b8 req-bd41be9c-5aea-4b61-a81e-3a7a9ce1a8a5 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received event network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dd7d1245-12a4-4d3c-b975-d08c92c0a5b8 req-bd41be9c-5aea-4b61-a81e-3a7a9ce1a8a5 service nova] Acquiring lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dd7d1245-12a4-4d3c-b975-d08c92c0a5b8 req-bd41be9c-5aea-4b61-a81e-3a7a9ce1a8a5 service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dd7d1245-12a4-4d3c-b975-d08c92c0a5b8 req-bd41be9c-5aea-4b61-a81e-3a7a9ce1a8a5 service nova] Lock "0324de51-3864-4a3b-bc2c-2046a9925275-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-dd7d1245-12a4-4d3c-b975-d08c92c0a5b8 req-bd41be9c-5aea-4b61-a81e-3a7a9ce1a8a5 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] No waiting events found dispatching network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:41 user nova-compute[72904]: WARNING nova.compute.manager [req-dd7d1245-12a4-4d3c-b975-d08c92c0a5b8 req-bd41be9c-5aea-4b61-a81e-3a7a9ce1a8a5 service nova] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Received unexpected event network-vif-plugged-9fb311a0-3c71-4174-9b3e-cf768cd5aa89 for instance with vm_state active and task_state deleting.
Aug 27 05:00:42 user nova-compute[72904]: INFO nova.compute.manager [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Took 0.89 seconds to detach 1 volumes for instance.
Aug 27 05:00:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:42 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:00:42 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:00:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:42 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Deleted allocations for instance 0324de51-3864-4a3b-bc2c-2046a9925275
Aug 27 05:00:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5d9a5948-6ebb-4dee-9982-b74a05462198 tempest-DeleteServersTestJSON-1381558065 tempest-DeleteServersTestJSON-1381558065-project-member] Lock "0324de51-3864-4a3b-bc2c-2046a9925275" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.679s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:46 user nova-compute[72904]: INFO nova.virt.block_device [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Booting with volume 0d0e2668-10a3-4d0d-84c8-db0427991199 at /dev/vdc
Aug 27 05:00:47 user nova-compute[72904]: DEBUG os_brick.utils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[da33f135-6207-4e1c-ad73-6243e697671c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0509a10-d62a-499a-bdea-e03b8a978413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9798d159-5ca1-4968-b0f1-083216ad696d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e8e5e-d948-485b-acad-badc599cc633]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:47 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:00:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9bfb0b-f2f2-45eb-9b5d-1780933734e2]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG os_brick.utils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:47 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating existing volume attachment record: 77afcbcc-c0bc-4aa7-96f8-73eff016a194 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-changed-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Refreshing instance network info cache due to event network-changed-6031cf82-e9e2-4c84-bac3-27d01d92c0fc. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] Acquiring lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] Acquired lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG nova.network.neutron [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Refreshing network info cache for port 6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lazy-loading 'flavor' on Instance uuid 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:49 user nova-compute[72904]: INFO nova.compute.manager [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Attaching volume 7a7745be-465a-413c-8fb8-1d87b2e641c5 to /dev/vdb
Aug 27 05:00:49 user nova-compute[72904]: DEBUG os_brick.utils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[62396923-9600-4f5c-9d38-db7912e75229]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48e5d91-e3d4-4408-a836-421ca126fda5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a57b95b-304d-40ac-8165-12b857c53262]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[61559dbe-7d57-4b9d-b6d7-459d038cbce1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:49 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:00:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43cde18-779d-47ac-a1bf-dbc2816207b6]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG os_brick.utils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:49 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updating existing volume attachment record: 8f542b46-6b6b-4b40-851e-b735f1bdd1b1 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updated VIF entry in instance network info cache for port 6031cf82-e9e2-4c84-bac3-27d01d92c0fc. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updating instance_info_cache with network_info: [{"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-89641828-68b4-443d-8fb8-43c7666e539c req-129e0576-0481-4ec2-a6fc-b7e5f6834b8b service nova] Releasing lock "refresh_cache-3853715e-fce2-4c7c-b2a1-b8875866e0e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-changed-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Refreshing instance network info cache due to event network-changed-99601399-a7c6-4528-8750-14287da7d02d. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] Acquiring lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] Acquired lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Refreshing network info cache for port 99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updated VIF entry in instance network info cache for port 99601399-a7c6-4528-8750-14287da7d02d. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updating instance_info_cache with network_info: [{"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-235a6bea-58b3-4d95-a0b7-35177fa042a8 req-2338a673-5d8e-4678-91e6-797809efca03 service nova] Releasing lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-changed-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Refreshing instance network info cache due to event network-changed-64c8e17d-17d8-49b8-8264-b8b56c9c27c0. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] Acquiring lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] Acquired lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Refreshing network info cache for port 64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "interface-e165c9ab-f2e0-43b4-bdcd-d92abd46c424-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "interface-e165c9ab-f2e0-43b4-bdcd-d92abd46c424-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.objects.instance [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'flavor' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updated VIF entry in instance network info cache for port 64c8e17d-17d8-49b8-8264-b8b56c9c27c0. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating instance_info_cache with network_info: [{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-383ed347-ed82-4b73-a038-b6ea24011f38 req-5fdff7f4-939d-4b50-aaa9-ab3b5f03c933 service nova] Releasing lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-changed-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Refreshing instance network info cache due to event network-changed-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] Acquiring lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] Acquired lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Refreshing network info cache for port 6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.objects.instance [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'pci_requests' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.objects.base [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Object Instance<e165c9ab-f2e0-43b4-bdcd-d92abd46c424> lazy-loaded attributes: flavor,pci_requests {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:00:53 user nova-compute[72904]: DEBUG nova.policy [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aad703280f584c9da9c6aeb37d328dc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee8b8fa582214642ba95f4e685a954c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:00:54 user nova-compute[72904]: DEBUG nova.network.neutron [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Updated VIF entry in instance network info cache for port 6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:54 user nova-compute[72904]: DEBUG nova.network.neutron [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Updating instance_info_cache with network_info: [{"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fa87c254-593d-4930-90af-9f6b305aaa0c req-f5950ded-ad2d-417c-ac10-c9d6e5e1446e service nova] Releasing lock "refresh_cache-b2fdad0c-92d6-4af6-b3aa-db138564bdf0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG nova.network.neutron [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Successfully created port: 7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112440.1342347, 0324de51-3864-4a3b-bc2c-2046a9925275 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:00:55 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] VM Stopped (Lifecycle Event)
Aug 27 05:00:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-88d3c9d0-d59b-49d5-984f-ff5042682614 None None] [instance: 0324de51-3864-4a3b-bc2c-2046a9925275] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG nova.objects.instance [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lazy-loading 'flavor' on Instance uuid 660b1c77-120e-40d5-b698-b89ec506caf3 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:55 user nova-compute[72904]: INFO nova.compute.manager [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Attaching volume 91e1c51a-5b35-44f3-b424-a3d39eb068a8 to /dev/vdb
Aug 27 05:00:55 user nova-compute[72904]: DEBUG os_brick.utils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add644a-4604-42da-894a-b00d1d045c41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af560a6-8813-4f51-b691-9b16313fd94e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e284f-6ca2-4d32-a7da-c747a005e07c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f364a455-b4a2-42a4-b901-3ba4d7613e1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:00:55 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:00:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0647110e-913b-4aee-ae36-3f81c0276a7a]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG os_brick.utils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updating existing volume attachment record: 03f6dcae-19c9-40ca-92c3-14930b61bbd7 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:00:55 user nova-compute[72904]: DEBUG nova.network.neutron [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Successfully updated port: 7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquired lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.network.neutron [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-changed-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Refreshing instance network info cache due to event network-changed-7ab24d9d-287f-4d6c-bcd1-0e699e77a669. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] Acquiring lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.network.neutron [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating instance_info_cache with network_info: [{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Releasing lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] Acquired lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.network.neutron [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Refreshing network info cache for port 7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1342835485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1342835485',id=7,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAciaZPZaCJGxXOOKlsbJ//xWfo4ksogNHfXMFLKueAWuieNVHgrMq6LO1M4N0Uyjna8u9qjgK5y9el1SbwjNLuHaSB/p3SpBWGFdOSomnz5j6eWVQ97zEHQWWQdnd6WfA==',key_name='tempest-keypair-109214732',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee8b8fa582214642ba95f4e685a954c8',ramdisk_id='',reservation_id='r-0e137ibn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-67395385',owner_user_name='tempest-TaggedAttachmentsTest-67395385-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad703280f584c9da9c6aeb37d328dc2',uuid=e165c9ab-f2e0-43b4-bdcd-d92abd46c424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converting VIF {"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG os_vif [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ab24d9d-28, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ab24d9d-28, col_values=(('external_ids', {'iface-id': '7ab24d9d-287f-4d6c-bcd1-0e699e77a669', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:2e:f6', 'vm-uuid': 'e165c9ab-f2e0-43b4-bdcd-d92abd46c424'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:56 user nova-compute[72904]: INFO os_vif [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28')
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1342835485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1342835485',id=7,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAciaZPZaCJGxXOOKlsbJ//xWfo4ksogNHfXMFLKueAWuieNVHgrMq6LO1M4N0Uyjna8u9qjgK5y9el1SbwjNLuHaSB/p3SpBWGFdOSomnz5j6eWVQ97zEHQWWQdnd6WfA==',key_name='tempest-keypair-109214732',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee8b8fa582214642ba95f4e685a954c8',ramdisk_id='',reservation_id='r-0e137ibn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-67395385',owner_user_name='tempest-TaggedAttachmentsTest-67395385-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad703280f584c9da9c6aeb37d328dc2',uuid=e165c9ab-f2e0-43b4-bdcd-d92abd46c424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converting VIF {"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] attach device xml: <interface type="ethernet">
Aug 27 05:00:56 user nova-compute[72904]:   <mac address="fa:16:3e:47:2e:f6"/>
Aug 27 05:00:56 user nova-compute[72904]:   <model type="virtio"/>
Aug 27 05:00:56 user nova-compute[72904]:   <mtu size="1442"/>
Aug 27 05:00:56 user nova-compute[72904]:   <target dev="tap7ab24d9d-28"/>
Aug 27 05:00:56 user nova-compute[72904]: </interface>
Aug 27 05:00:56 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No BDM found with device name hda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No VIF found with MAC fa:16:3e:5c:fc:49, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:00:57 user nova-compute[72904]:   <nova:package version="0.0.0"/>
Aug 27 05:00:57 user nova-compute[72904]:   <nova:name>tempest-device-tagging-server-1342835485</nova:name>
Aug 27 05:00:57 user nova-compute[72904]:   <nova:creationTime>2023-08-27 05:00:57</nova:creationTime>
Aug 27 05:00:57 user nova-compute[72904]:   <nova:flavor name="m1.tiny">
Aug 27 05:00:57 user nova-compute[72904]:     <nova:memory>512</nova:memory>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:disk>1</nova:disk>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:swap>0</nova:swap>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:vcpus>1</nova:vcpus>
Aug 27 05:00:57 user nova-compute[72904]:   </nova:flavor>
Aug 27 05:00:57 user nova-compute[72904]:   <nova:owner>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:user uuid="aad703280f584c9da9c6aeb37d328dc2">tempest-TaggedAttachmentsTest-67395385-project-member</nova:user>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:project uuid="ee8b8fa582214642ba95f4e685a954c8">tempest-TaggedAttachmentsTest-67395385</nova:project>
Aug 27 05:00:57 user nova-compute[72904]:   </nova:owner>
Aug 27 05:00:57 user nova-compute[72904]:   <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:00:57 user nova-compute[72904]:   <nova:ports>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:port uuid="64c8e17d-17d8-49b8-8264-b8b56c9c27c0">
Aug 27 05:00:57 user nova-compute[72904]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 05:00:57 user nova-compute[72904]:     </nova:port>
Aug 27 05:00:57 user nova-compute[72904]:     <nova:port uuid="7ab24d9d-287f-4d6c-bcd1-0e699e77a669">
Aug 27 05:00:57 user nova-compute[72904]:       <nova:ip type="fixed" address="10.10.10.74" ipVersion="4"/>
Aug 27 05:00:57 user nova-compute[72904]:     </nova:port>
Aug 27 05:00:57 user nova-compute[72904]:   </nova:ports>
Aug 27 05:00:57 user nova-compute[72904]: </nova:instance>
Aug 27 05:00:57 user nova-compute[72904]:  {{(pid=72904) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-de681c2e-ec1f-4f94-9074-2bd4a0579ef2 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "interface-e165c9ab-f2e0-43b4-bdcd-d92abd46c424-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.991s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG nova.network.neutron [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updated VIF entry in instance network info cache for port 7ab24d9d-287f-4d6c-bcd1-0e699e77a669. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG nova.network.neutron [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating instance_info_cache with network_info: [{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ded1a10-8fcd-487d-8428-ae8c8aca8f72 req-91478374-e414-4c4d-a50c-14dc84daa901 service nova] Releasing lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:58 user nova-compute[72904]: WARNING nova.compute.manager [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received unexpected event network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 for instance with vm_state active and task_state None.
Aug 27 05:00:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:00:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:00:58 user nova-compute[72904]: WARNING nova.compute.manager [req-a3109819-e02f-47fe-b6a7-cb991790a5ac req-b4286087-9e51-45d0-840d-f54b9b04bf2f service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received unexpected event network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 for instance with vm_state active and task_state None.
Aug 27 05:01:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'flavor' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:01:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Creating image(s)
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Ensure instance console log exists: /opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Start _get_guest_xml network_info=[{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '974f1a92-1382-4285-a196-50ce48e4b133', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pwyMKCDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd8444b2-1511-446b-8139-3809a4a12e5b', 'attached_at': '', 'detached_at': '', 'volume_id': '8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3', 'serial': '8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '4bf1a51f-ed5d-4090-8b9a-b92a1bfa2de2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okDwyQmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd8444b2-1511-446b-8139-3809a4a12e5b', 'attached_at': '', 'detached_at': '', 'volume_id': '91950a7d-c9fe-4606-b4ff-dd8f2cb31755', 'serial': '91950a7d-c9fe-4606-b4ff-dd8f2cb31755'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'attachment_id': '77afcbcc-c0bc-4aa7-96f8-73eff016a194', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neLZcEoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bd8444b2-1511-446b-8139-3809a4a12e5b', 'attached_at': '', 'detached_at': '', 'volume_id': '0d0e2668-10a3-4d0d-84c8-db0427991199', 'serial': '0d0e2668-10a3-4d0d-84c8-db0427991199'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:01:04 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:01:04 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pwyMKCDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:04 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:04 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:04 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lazy-loading 'flavor' on Instance uuid b2fdad0c-92d6-4af6-b3aa-db138564bdf0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1775cd-4395-4155-bc26-58392531478d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:04 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4115959f-02d4-4145-957f-4a5db045f50c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3] added
Aug 27 05:01:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a372550f-90d1-4319-b3cd-8c0a33ad2fcc]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[153faf0f-d1a8-48cf-88b2-10927264a404]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pwyMKCDJ {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pwyMKCDJ" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a369b4a-994a-4884-9578-875b5d6f0722]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pwyMKCDJ'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:04 user nova-compute[72904]: INFO nova.compute.manager [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Attaching volume bf05f88a-ebf1-4638-8315-d653f1aeb26b to /dev/vdb
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cade2482-c8e1-4ece-a34b-075855ceca69]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[299e843b-3057-44a1-a20c-4c7c76e6babb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6968a9-50e8-4b02-acd2-e575bd70721f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260]
Aug 27 05:01:04 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:04 user nova-compute[72904]: INFO nova.compute.manager [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Attaching volume 87c45f08-29a9-4e19-bc81-025ea932c17c to /dev/sdc
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3152cdb8-49da-4186-a1ab-7de9fbd803ee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b406d3ab-6922-4fbe-988f-cc24f763fb49]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:04 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b14e8c-68e1-48df-a43d-10089a711a05]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pwyMKCDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.utils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adee791-2ac8-4968-99ff-17105881b344]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf47b69f-b868-450c-b3df-c5bd0169789f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.utils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c64a41-2c42-4503-8f3b-ea0958fe743c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada7202a-714b-4455-a396-0c3522d79af4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a690b4-aa87-4ac6-83ef-56f9ae29684a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b214c3-c739-43cb-9ef3-a9fea202f1f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:04 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ffc0c5-586b-40e2-a7de-9545f08d4243]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.utils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating existing volume attachment record: a335bb20-dfcd-4625-8b2f-a9a40ae03cce {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[298f0563-4aab-4ae7-aaa1-043a4a714361]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d13ca-7a8c-4a1f-906a-21c82618615e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:04 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:01:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6d5eaf-a1a7-40d5-9b7b-e2635aac222e]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG os_brick.utils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] <== get_connector_properties: return (203ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:04 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Updating existing volume attachment record: bb925e9c-5ae6-4653-baac-10e26778ccae {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23665326435336136', 'path': '/dev/sde'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665326435336136', 'path': '/dev/sde'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okDwyQmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:05 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[513d9866-bf3c-407a-9a6c-45f3f0c8f54f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:05 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee51d043-f4c9-48fd-8a97-7010b3a3133f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755] added
Aug 27 05:01:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[119a76b5-9591-4164-8254-3f442f67ae82]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[593546e8-cbba-4180-af92-de19f068da20]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okDwyQmX {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v okDwyQmX" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf500c2a-be25-4024-928a-c6f837b4a2d4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'okDwyQmX'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cfac3d-2b39-4f8c-94f4-b5236447b4a4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f5c0d-6ae2-4110-b115-0d88234bd6d9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:05 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:05 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:05 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:05 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:05 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:05 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2091aed-dcbc-4127-8371-3d2b620435f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260]
Aug 27 05:01:06 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:06 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e0b6a-8409-4aff-b005-a537866a9290]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a36289c-f724-4775-8409-fd9bcdabf633]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:06 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:06 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:06 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c262722a-82df-4c6a-bd5f-4cf92148e744]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okDwyQmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== connect_volume: return (1409ms) {'type': 'block', 'scsi_wwn': '26463316435666338', 'path': '/dev/sdf'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463316435666338', 'path': '/dev/sdf'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neLZcEoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:07 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:07 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:07 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e7744-26d9-4bd0-bc43-f77ac8840886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:07 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c7956c-9626-4e8b-b33e-31b6db75c151]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199] added
Aug 27 05:01:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[542567fc-28a2-42b5-855f-6a78a3da2125]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e223da66-5c7a-4684-97ef-aea572ef3bef]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v neLZcEoz {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v neLZcEoz" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb8de0b-845b-4bf7-b2e3-0ac810775738]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'neLZcEoz'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c014a9-f780-4a4d-b0e6-be5c92c61419]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928d9da-a4a1-4cf3-83a0-2d3c7d476d2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b71c5-dc3c-421d-863f-b40800180850]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260]
Aug 27 05:01:07 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc0e916-cfcb-4e4f-a64f-2b52e475b5f7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22d49a8-2c9d-4425-96e6-0f9893b0b3f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d87549-4ba7-4bac-a47e-bbeffb37ee40]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neLZcEoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23965666330323731', 'path': '/dev/sdg'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965666330323731', 'path': '/dev/sdg'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:3f:23,bridge_name='br-int',has_traffic_filtering=True,id=04b5cb8f-d374-4b57-a4d6-59a6338f88ae,network=Network(01db7bb6-6663-4f56-a0e1-1982c4584e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5cb8f-d3') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:78:2a,bridge_name='br-int',has_traffic_filtering=True,id=44588416-88f1-44a9-913d-0b4270e4c2c1,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44588416-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=decd4865-3f96-4ebc-8c49-2e6e3342c870,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecd4865-3f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:91:43,bridge_name='br-int',has_traffic_filtering=True,id=2ef82d54-e731-4761-82fa-49fcc3a33dc0,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef82d54-e7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b6e6460-b500-4589-af0b-6927510c9e49,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e6460-b5') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8d8efd4c-6aad-4bdf-b865-080a929bb813,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8efd4c-6a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=20686a0f-ec45-4c05-aae9-872242a5cd3e,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20686a0f-ec') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lazy-loading 'pci_devices' on Instance uuid bd8444b2-1511-446b-8139-3809a4a12e5b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:01:08 user nova-compute[72904]:   <uuid>bd8444b2-1511-446b-8139-3809a4a12e5b</uuid>
Aug 27 05:01:08 user nova-compute[72904]:   <name>instance-0000000b</name>
Aug 27 05:01:08 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:01:08 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:01:08 user nova-compute[72904]:   <metadata>
Aug 27 05:01:08 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:01:08 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:01:08 user nova-compute[72904]:       <nova:name>tempest-device-tagging-server-1603366599</nova:name>
Aug 27 05:01:08 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:01:04</nova:creationTime>
Aug 27 05:01:08 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:01:08 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:01:08 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:01:08 user nova-compute[72904]:       <nova:owner>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:user uuid="d346fd49936b48d4a55681a18b70f0f6">tempest-TaggedBootDevicesTest_v242-96474791-project-member</nova:user>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:project uuid="3a6ee805ec6241d0a7159d2add36aa10">tempest-TaggedBootDevicesTest_v242-96474791</nova:project>
Aug 27 05:01:08 user nova-compute[72904]:       </nova:owner>
Aug 27 05:01:08 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:01:08 user nova-compute[72904]:       <nova:ports>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:port uuid="04b5cb8f-d374-4b57-a4d6-59a6338f88ae">
Aug 27 05:01:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 05:01:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:port uuid="44588416-88f1-44a9-913d-0b4270e4c2c1">
Aug 27 05:01:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Aug 27 05:01:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:port uuid="decd4865-3f96-4ebc-8c49-2e6e3342c870">
Aug 27 05:01:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
Aug 27 05:01:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:port uuid="2ef82d54-e731-4761-82fa-49fcc3a33dc0">
Aug 27 05:01:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Aug 27 05:01:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:port uuid="2b6e6460-b500-4589-af0b-6927510c9e49">
Aug 27 05:01:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Aug 27 05:01:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:port uuid="8d8efd4c-6aad-4bdf-b865-080a929bb813">
Aug 27 05:01:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 27 05:01:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:01:08 user nova-compute[72904]:         <nova:port uuid="20686a0f-ec45-4c05-aae9-872242a5cd3e">
Aug 27 05:01:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 27 05:01:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:01:08 user nova-compute[72904]:       </nova:ports>
Aug 27 05:01:08 user nova-compute[72904]:     </nova:instance>
Aug 27 05:01:08 user nova-compute[72904]:   </metadata>
Aug 27 05:01:08 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:01:08 user nova-compute[72904]:     <system>
Aug 27 05:01:08 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:01:08 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:01:08 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:01:08 user nova-compute[72904]:       <entry name="serial">bd8444b2-1511-446b-8139-3809a4a12e5b</entry>
Aug 27 05:01:08 user nova-compute[72904]:       <entry name="uuid">bd8444b2-1511-446b-8139-3809a4a12e5b</entry>
Aug 27 05:01:08 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:01:08 user nova-compute[72904]:     </system>
Aug 27 05:01:08 user nova-compute[72904]:   </sysinfo>
Aug 27 05:01:08 user nova-compute[72904]:   <os>
Aug 27 05:01:08 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:01:08 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:01:08 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:01:08 user nova-compute[72904]:   </os>
Aug 27 05:01:08 user nova-compute[72904]:   <features>
Aug 27 05:01:08 user nova-compute[72904]:     <acpi/>
Aug 27 05:01:08 user nova-compute[72904]:     <apic/>
Aug 27 05:01:08 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:01:08 user nova-compute[72904]:   </features>
Aug 27 05:01:08 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:01:08 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:01:08 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:01:08 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:01:08 user nova-compute[72904]:   </clock>
Aug 27 05:01:08 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:01:08 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:01:08 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:01:08 user nova-compute[72904]:   </cpu>
Aug 27 05:01:08 user nova-compute[72904]:   <devices>
Aug 27 05:01:08 user nova-compute[72904]:     <disk type="file" device="cdrom">
Aug 27 05:01:08 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none"/>
Aug 27 05:01:08 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b/disk.config"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="hda" bus="ide"/>
Aug 27 05:01:08 user nova-compute[72904]:     </disk>
Aug 27 05:01:08 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:01:08 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:08 user nova-compute[72904]:       <source dev="/dev/sde"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <serial>8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3</serial>
Aug 27 05:01:08 user nova-compute[72904]:     </disk>
Aug 27 05:01:08 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:01:08 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:08 user nova-compute[72904]:       <source dev="/dev/sdf"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <serial>91950a7d-c9fe-4606-b4ff-dd8f2cb31755</serial>
Aug 27 05:01:08 user nova-compute[72904]:     </disk>
Aug 27 05:01:08 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:01:08 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:08 user nova-compute[72904]:       <source dev="/dev/sdg"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="vdc" bus="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <serial>0d0e2668-10a3-4d0d-84c8-db0427991199</serial>
Aug 27 05:01:08 user nova-compute[72904]:     </disk>
Aug 27 05:01:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:01:08 user nova-compute[72904]:       <mac address="fa:16:3e:c2:3f:23"/>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="tap04b5cb8f-d3"/>
Aug 27 05:01:08 user nova-compute[72904]:     </interface>
Aug 27 05:01:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:01:08 user nova-compute[72904]:       <mac address="fa:16:3e:2e:78:2a"/>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="tap44588416-88"/>
Aug 27 05:01:08 user nova-compute[72904]:     </interface>
Aug 27 05:01:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:01:08 user nova-compute[72904]:       <mac address="fa:16:3e:28:76:0b"/>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="tapdecd4865-3f"/>
Aug 27 05:01:08 user nova-compute[72904]:     </interface>
Aug 27 05:01:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:01:08 user nova-compute[72904]:       <mac address="fa:16:3e:c3:91:43"/>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="tap2ef82d54-e7"/>
Aug 27 05:01:08 user nova-compute[72904]:     </interface>
Aug 27 05:01:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:01:08 user nova-compute[72904]:       <mac address="fa:16:3e:36:87:a1"/>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="tap2b6e6460-b5"/>
Aug 27 05:01:08 user nova-compute[72904]:     </interface>
Aug 27 05:01:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:01:08 user nova-compute[72904]:       <mac address="fa:16:3e:41:12:e9"/>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="tap8d8efd4c-6a"/>
Aug 27 05:01:08 user nova-compute[72904]:     </interface>
Aug 27 05:01:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:01:08 user nova-compute[72904]:       <mac address="fa:16:3e:66:6d:ad"/>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:01:08 user nova-compute[72904]:       <target dev="tap20686a0f-ec"/>
Aug 27 05:01:08 user nova-compute[72904]:     </interface>
Aug 27 05:01:08 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:01:08 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b/console.log" append="off"/>
Aug 27 05:01:08 user nova-compute[72904]:     </serial>
Aug 27 05:01:08 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:01:08 user nova-compute[72904]:     <video>
Aug 27 05:01:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:01:08 user nova-compute[72904]:     </video>
Aug 27 05:01:08 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:01:08 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:01:08 user nova-compute[72904]:     </rng>
Aug 27 05:01:08 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:01:08 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:01:08 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:01:08 user nova-compute[72904]:     </memballoon>
Aug 27 05:01:08 user nova-compute[72904]:   </devices>
Aug 27 05:01:08 user nova-compute[72904]: </domain>
Aug 27 05:01:08 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:3f:23,bridge_name='br-int',has_traffic_filtering=True,id=04b5cb8f-d374-4b57-a4d6-59a6338f88ae,network=Network(01db7bb6-6663-4f56-a0e1-1982c4584e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5cb8f-d3') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:3f:23,bridge_name='br-int',has_traffic_filtering=True,id=04b5cb8f-d374-4b57-a4d6-59a6338f88ae,network=Network(01db7bb6-6663-4f56-a0e1-1982c4584e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5cb8f-d3') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04b5cb8f-d3, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04b5cb8f-d3, col_values=(('external_ids', {'iface-id': '04b5cb8f-d374-4b57-a4d6-59a6338f88ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:3f:23', 'vm-uuid': 'bd8444b2-1511-446b-8139-3809a4a12e5b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: INFO os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:3f:23,bridge_name='br-int',has_traffic_filtering=True,id=04b5cb8f-d374-4b57-a4d6-59a6338f88ae,network=Network(01db7bb6-6663-4f56-a0e1-1982c4584e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5cb8f-d3')
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:78:2a,bridge_name='br-int',has_traffic_filtering=True,id=44588416-88f1-44a9-913d-0b4270e4c2c1,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44588416-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:78:2a,bridge_name='br-int',has_traffic_filtering=True,id=44588416-88f1-44a9-913d-0b4270e4c2c1,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44588416-88') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44588416-88, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44588416-88, col_values=(('external_ids', {'iface-id': '44588416-88f1-44a9-913d-0b4270e4c2c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:78:2a', 'vm-uuid': 'bd8444b2-1511-446b-8139-3809a4a12e5b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: INFO os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:78:2a,bridge_name='br-int',has_traffic_filtering=True,id=44588416-88f1-44a9-913d-0b4270e4c2c1,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44588416-88')
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=decd4865-3f96-4ebc-8c49-2e6e3342c870,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecd4865-3f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=decd4865-3f96-4ebc-8c49-2e6e3342c870,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecd4865-3f') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdecd4865-3f, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdecd4865-3f, col_values=(('external_ids', {'iface-id': 'decd4865-3f96-4ebc-8c49-2e6e3342c870', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:76:0b', 'vm-uuid': 'bd8444b2-1511-446b-8139-3809a4a12e5b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: INFO os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=decd4865-3f96-4ebc-8c49-2e6e3342c870,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecd4865-3f')
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:91:43,bridge_name='br-int',has_traffic_filtering=True,id=2ef82d54-e731-4761-82fa-49fcc3a33dc0,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef82d54-e7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:91:43,bridge_name='br-int',has_traffic_filtering=True,id=2ef82d54-e731-4761-82fa-49fcc3a33dc0,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef82d54-e7') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ef82d54-e7, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ef82d54-e7, col_values=(('external_ids', {'iface-id': '2ef82d54-e731-4761-82fa-49fcc3a33dc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:91:43', 'vm-uuid': 'bd8444b2-1511-446b-8139-3809a4a12e5b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: INFO os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:91:43,bridge_name='br-int',has_traffic_filtering=True,id=2ef82d54-e731-4761-82fa-49fcc3a33dc0,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef82d54-e7')
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b6e6460-b500-4589-af0b-6927510c9e49,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e6460-b5') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b6e6460-b500-4589-af0b-6927510c9e49,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e6460-b5') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b6e6460-b5, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b6e6460-b5, col_values=(('external_ids', {'iface-id': '2b6e6460-b500-4589-af0b-6927510c9e49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:87:a1', 'vm-uuid': 'bd8444b2-1511-446b-8139-3809a4a12e5b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-changed-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Refreshing instance network info cache due to event network-changed-bf207583-6614-42c4-8d4a-1c22ff7d62e9. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] Acquiring lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] Acquired lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.neutron [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Refreshing network info cache for port bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: INFO os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b6e6460-b500-4589-af0b-6927510c9e49,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e6460-b5')
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8d8efd4c-6aad-4bdf-b865-080a929bb813,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8efd4c-6a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8d8efd4c-6aad-4bdf-b865-080a929bb813,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8efd4c-6a') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d8efd4c-6a, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d8efd4c-6a, col_values=(('external_ids', {'iface-id': '8d8efd4c-6aad-4bdf-b865-080a929bb813', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:12:e9', 'vm-uuid': 'bd8444b2-1511-446b-8139-3809a4a12e5b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: INFO os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8d8efd4c-6aad-4bdf-b865-080a929bb813,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8efd4c-6a')
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=20686a0f-ec45-4c05-aae9-872242a5cd3e,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20686a0f-ec') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=20686a0f-ec45-4c05-aae9-872242a5cd3e,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20686a0f-ec') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20686a0f-ec, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20686a0f-ec, col_values=(('external_ids', {'iface-id': '20686a0f-ec45-4c05-aae9-872242a5cd3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:6d:ad', 'vm-uuid': 'bd8444b2-1511-446b-8139-3809a4a12e5b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:09 user nova-compute[72904]: INFO os_vif [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=20686a0f-ec45-4c05-aae9-872242a5cd3e,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20686a0f-ec')
Aug 27 05:01:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] No BDM found with device name hda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] No VIF found with MAC fa:16:3e:c2:3f:23, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] No VIF found with MAC fa:16:3e:36:87:a1, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:01:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Using config drive
Aug 27 05:01:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Creating config drive at /opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b/disk.config
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq0aqy0s1 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpq0aqy0s1" returned: 0 in 0.055s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG nova.network.neutron [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Updated VIF entry in instance network info cache for port bf207583-6614-42c4-8d4a-1c22ff7d62e9. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG nova.network.neutron [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Updating instance_info_cache with network_info: [{"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-581f9ad3-4aeb-44f1-8abe-d40bc3e73543 req-c7f05a71-32da-43f6-9343-5094ccc80b7c service nova] Releasing lock "refresh_cache-72995227-dd52-4b04-a119-41c34dc2e43b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zivHbAjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:09 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:09 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:09 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a65dcdd-3bd3-46a8-ab52-ddd497e1ea64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:09 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce655042-8dbc-4038-905d-11ceac9dfc4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8] added
Aug 27 05:01:09 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.094s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a275a-404d-4c1b-a0bf-876d6d0eecc8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d00a24d-2dc8-44dd-a6c6-5c5dbcb5658b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zivHbAjc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zivHbAjc" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7b044b-a0fb-4358-bbfa-14ba7e0e3d84]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zivHbAjc'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d46df0-1c07-4950-8540-152bdf1bb453]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[766180b0-3d47-4c7d-b693-ecfc7149ec0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:09 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ab3242-41ea-4e13-a5a8-92b9d5b92600]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260]
Aug 27 05:01:10 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec19fdde-c905-4b6e-852f-5e92b62171b1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9882d-bf8d-48ea-8f78-f8cd658be2b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27b67ee-2632-48ac-9fca-fdc409a5bfb8]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zivHbAjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23166306130353533', 'path': '/dev/sdh'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166306130353533', 'path': '/dev/sdh'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG nova.objects.instance [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lazy-loading 'flavor' on Instance uuid 660b1c77-120e-40d5-b698-b89ec506caf3 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:01:11 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:11 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:01:11 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:11 user nova-compute[72904]:   <serial>91e1c51a-5b35-44f3-b424-a3d39eb068a8</serial>
Aug 27 05:01:11 user nova-compute[72904]: </disk>
Aug 27 05:01:11 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-77c00772-2f91-485b-881f-93eb163efe9c req-8c809398-a3ac-4f04-af87-7027071f010e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-77c00772-2f91-485b-881f-93eb163efe9c req-8c809398-a3ac-4f04-af87-7027071f010e service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-77c00772-2f91-485b-881f-93eb163efe9c req-8c809398-a3ac-4f04-af87-7027071f010e service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-77c00772-2f91-485b-881f-93eb163efe9c req-8c809398-a3ac-4f04-af87-7027071f010e service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-77c00772-2f91-485b-881f-93eb163efe9c req-8c809398-a3ac-4f04-af87-7027071f010e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:11 user nova-compute[72904]: WARNING nova.compute.manager [req-77c00772-2f91-485b-881f-93eb163efe9c req-8c809398-a3ac-4f04-af87-7027071f010e service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae for instance with vm_state building and task_state spawning.
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ab3d560-f96e-4ea9-93fc-2b264218b794 req-a56785dc-fd9e-4c51-af4c-3f98c6ef5557 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ab3d560-f96e-4ea9-93fc-2b264218b794 req-a56785dc-fd9e-4c51-af4c-3f98c6ef5557 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ab3d560-f96e-4ea9-93fc-2b264218b794 req-a56785dc-fd9e-4c51-af4c-3f98c6ef5557 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ab3d560-f96e-4ea9-93fc-2b264218b794 req-a56785dc-fd9e-4c51-af4c-3f98c6ef5557 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ab3d560-f96e-4ea9-93fc-2b264218b794 req-a56785dc-fd9e-4c51-af4c-3f98c6ef5557 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:11 user nova-compute[72904]: WARNING nova.compute.manager [req-9ab3d560-f96e-4ea9-93fc-2b264218b794 req-a56785dc-fd9e-4c51-af4c-3f98c6ef5557 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 for instance with vm_state building and task_state spawning.
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] No VIF found with MAC fa:16:3e:65:a9:5f, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-b9a2cf2c-0b70-441c-9be5-0e41bdefd33c req-9e40adb1-cec3-45e3-af2d-e463482fca49 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b9a2cf2c-0b70-441c-9be5-0e41bdefd33c req-9e40adb1-cec3-45e3-af2d-e463482fca49 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b9a2cf2c-0b70-441c-9be5-0e41bdefd33c req-9e40adb1-cec3-45e3-af2d-e463482fca49 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b9a2cf2c-0b70-441c-9be5-0e41bdefd33c req-9e40adb1-cec3-45e3-af2d-e463482fca49 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-b9a2cf2c-0b70-441c-9be5-0e41bdefd33c req-9e40adb1-cec3-45e3-af2d-e463482fca49 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:12 user nova-compute[72904]: WARNING nova.compute.manager [req-b9a2cf2c-0b70-441c-9be5-0e41bdefd33c req-9e40adb1-cec3-45e3-af2d-e463482fca49 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 for instance with vm_state building and task_state spawning.
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:13 user nova-compute[72904]: WARNING nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae for instance with vm_state building and task_state spawning.
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:13 user nova-compute[72904]: WARNING nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 for instance with vm_state building and task_state spawning.
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:13 user nova-compute[72904]: WARNING nova.compute.manager [req-e39a07f8-0d88-4138-9d36-ee7cea2193a2 req-b0490ae4-3df6-4577-9890-cb584114453a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 for instance with vm_state building and task_state spawning.
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:13 user nova-compute[72904]: WARNING nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 for instance with vm_state building and task_state spawning.
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:13 user nova-compute[72904]: WARNING nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 for instance with vm_state building and task_state spawning.
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:13 user nova-compute[72904]: WARNING nova.compute.manager [req-9554b37e-5164-4954-ba91-d52c9a424627 req-5cdead06-722c-4797-8799-a97f7de0c1aa service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 for instance with vm_state building and task_state spawning.
Aug 27 05:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:14 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:14 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:14 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c251b1-d1e9-4f79-9171-261eb8c7b226]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:14 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[647f8a7e-de28-45ff-b375-f5dbfd2cdcce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5] added
Aug 27 05:01:14 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3167d-f421-488a-8f3e-3c67fe1b4794]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2320f32-30b0-4d1d-932a-1643a530256e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJcdsBST {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJcdsBST" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f5b2bc-7d15-49f7-b4ca-73df2060b754]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJcdsBST'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2424890-b476-4674-8d3c-0e6b8db7b14b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:14 user nova-compute[72904]: WARNING nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 for instance with vm_state building and task_state spawning.
Aug 27 05:01:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:14 user nova-compute[72904]: WARNING nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 for instance with vm_state building and task_state spawning.
Aug 27 05:01:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:14 user nova-compute[72904]: WARNING nova.compute.manager [req-037a0fe1-3ecc-41c7-ab6d-3ca284c7c3d9 req-b19c88db-5825-4b45-94c1-d04eb86b3529 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 for instance with vm_state building and task_state spawning.
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9b21d4-1e5f-4af2-adcf-f21e5119014b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:14 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac536560-3074-4080-b30f-42bbd00cdf37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]
Aug 27 05:01:14 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:14 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0fd7c7-b7e0-48e5-abb8-3f43fa825014]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5781b6-8bb0-47ee-92cf-b5adf2578fba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[230745f3-dceb-4098-9869-e964373e6019]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.objects.instance [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lazy-loading 'flavor' on Instance uuid 72995227-dd52-4b04-a119-41c34dc2e43b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-22c81812-5de2-442c-8778-73b84f44074e tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.532s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:15 user nova-compute[72904]: WARNING nova.compute.manager [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e for instance with vm_state building and task_state spawning.
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:15 user nova-compute[72904]: WARNING nova.compute.manager [req-bcdb30e7-b9ab-4a3f-8905-1490d0eb94ab req-ae09a07d-253b-4fca-991a-650c90644417 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e for instance with vm_state building and task_state spawning.
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.compute.manager [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Attaching volume 210a3691-de5d-4d1c-8a21-2d2302828418 to /dev/vdb
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.utils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17d90a7-1333-4cbf-973f-24a358b99999]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb31b2-9102-424f-bd5a-88dade6a807e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cb2a40-4fda-4cf8-b2bc-d1e25f49aa80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[006105e8-8eb4-4e40-8b1a-fc7f5c9e7227]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112475.5889916, bd8444b2-1511-446b-8139-3809a4a12e5b => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] VM Resumed (Lifecycle Event)
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance spawned successfully.
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:15 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9135c4-de5b-4735-97c3-74ebfbad814a]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG os_brick.utils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Updating existing volume attachment record: be0b17a6-1a75-4e46-8492-3244d910c131 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112475.5908403, bd8444b2-1511-446b-8139-3809a4a12e5b => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] VM Started (Lifecycle Event)
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Took 11.51 seconds to spawn the instance on the hypervisor.
Aug 27 05:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:01:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:15 user nova-compute[72904]: INFO nova.compute.manager [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Took 74.23 seconds to build instance.
Aug 27 05:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-580eb679-0c6c-4f46-83ee-5288379a99b9 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 74.321s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23562323835356566', 'path': '/dev/sdi'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562323835356566', 'path': '/dev/sdi'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lazy-loading 'flavor' on Instance uuid 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:01:16 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:16 user nova-compute[72904]:   <source dev="/dev/sdi"/>
Aug 27 05:01:16 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:16 user nova-compute[72904]:   <serial>7a7745be-465a-413c-8fb8-1d87b2e641c5</serial>
Aug 27 05:01:16 user nova-compute[72904]: </disk>
Aug 27 05:01:16 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] No VIF found with MAC fa:16:3e:08:c5:91, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:01:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:01:23 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:01:23 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=6998MB free_disk=25.75374984741211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance cae1202f-0f6c-437e-8334-215b4736e061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 660b1c77-120e-40d5-b698-b89ec506caf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 72995227-dd52-4b04-a119-41c34dc2e43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 94a31275-2023-4fc1-a2ca-887a126972e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bd8444b2-1511-446b-8139-3809a4a12e5b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 93251700-8080-409f-8867-556781572964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKJbpiCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:24 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:24 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:24 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e0657d-3468-47bd-ba14-ae338fc640dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:24 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d542a6dc-216c-4b24-8c94-2366d02816f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c] added
Aug 27 05:01:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d23d240-8592-45e8-a21b-f7c225f2b35a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f6657-70c3-4ec4-b196-b8c5e0a3d470]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKJbpiCg {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKJbpiCg" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0d5e08-21ef-4c04-a7b0-41cecb519d36]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kKJbpiCg'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c360ba-f996-4fe6-8ed1-24e6686ae1d1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea2ff38-b67f-4ce6-b17d-aeb212816c62]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb292b2-c185-4169-b577-d4c45979828e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260]
Aug 27 05:01:24 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9755fa-72cf-4849-8fc6-17ff784a6427]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc11740c-57d6-4907-9883-8378a40b626a tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.724s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[10258bec-b9e4-4da6-93d6-4953b6c8edcd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c3c3c3-6d8f-4fd8-9ec9-2e6202df3932]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKJbpiCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:25 user nova-compute[72904]: INFO nova.compute.manager [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Detaching volume 91e1c51a-5b35-44f3-b424-a3d39eb068a8
Aug 27 05:01:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23931616333366338', 'path': '/dev/sdj'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931616333366338', 'path': '/dev/sdj'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lazy-loading 'flavor' on Instance uuid b2fdad0c-92d6-4af6-b3aa-db138564bdf0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:01:25 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:25 user nova-compute[72904]:   <source dev="/dev/sdj"/>
Aug 27 05:01:25 user nova-compute[72904]:   <target dev="sdc" bus="scsi"/>
Aug 27 05:01:25 user nova-compute[72904]:   <serial>87c45f08-29a9-4e19-bc81-025ea932c17c</serial>
Aug 27 05:01:25 user nova-compute[72904]:   <address type="drive" controller="0" unit="2"/>
Aug 27 05:01:25 user nova-compute[72904]: </disk>
Aug 27 05:01:25 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:01:25 user nova-compute[72904]: INFO nova.virt.block_device [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Attempting to driver detach volume 91e1c51a-5b35-44f3-b424-a3d39eb068a8 from mountpoint /dev/vdb
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Attempting to detach device vdb from instance 660b1c77-120e-40d5-b698-b89ec506caf3 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:25 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:25 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:01:25 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:25 user nova-compute[72904]:   <serial>91e1c51a-5b35-44f3-b424-a3d39eb068a8</serial>
Aug 27 05:01:25 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:01:25 user nova-compute[72904]: </disk>
Aug 27 05:01:25 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Successfully detached device vdb from instance 660b1c77-120e-40d5-b698-b89ec506caf3 from the persistent domain config.
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 660b1c77-120e-40d5-b698-b89ec506caf3 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:25 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:25 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:01:25 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:25 user nova-compute[72904]:   <serial>91e1c51a-5b35-44f3-b424-a3d39eb068a8</serial>
Aug 27 05:01:25 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:01:25 user nova-compute[72904]: </disk>
Aug 27 05:01:25 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.utils [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[61963eb1-5763-4d70-a4cc-09b22ffc139a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1f172-f07f-4bd8-af19-3e8aaed6de10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a282cf-8c28-4de9-b8c9-033c77ca876d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[56894e0a-e5eb-472b-8195-59abbcfaacce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:26 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[25816fad-e815-41b1-9d5d-ff223a6ef528]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.utils [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] No BDM found with device name sda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] No VIF found with MAC fa:16:3e:de:d1:ef, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:01:26 user nova-compute[72904]: INFO nova.compute.manager [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Swapping volume 7a7745be-465a-413c-8fb8-1d87b2e641c5 for a85f8113-1c12-437e-8f26-b54471cf9a70
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693112486.358748, 660b1c77-120e-40d5-b698-b89ec506caf3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 660b1c77-120e-40d5-b698-b89ec506caf3 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:01:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Successfully detached device vdb from instance 660b1c77-120e-40d5-b698-b89ec506caf3 from the live domain config.
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zivHbAjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:26 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e2a5e670-cb0a-48eb-a2d5-9db2ff93b90d tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.789s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0c0706-6127-4768-a9c7-526a76bb052f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[986575b1-29c5-46f9-a26b-ca91109e732b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 (non-flash)
Aug 27 05:01:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91941d40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8'): ({'sdh'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Removing single pathed devices sdh {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1636ce10-5f05-41cb-89a8-66c0a00b997b]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ac1721-619d-41cf-a409-c4a07d1be721]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Flushing IO for device /dev/sdh {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32503b3-2ef5-47c9-8519-4b3625131b23]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac8c6a4-7684-4c0b-b605-528a365d3211]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] SCSI volumes sdh have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea488a35-d75f-4b60-a782-c031e743280c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c560db3d-bdf3-48bb-b75c-7be2f8c3406c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260]
Aug 27 05:01:26 user nova-compute[72904]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91e1c51a-5b35-44f3-b424-a3d39eb068a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[de396163-1ce7-474f-9847-b241b434b3a5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] <== disconnect_volume: return (372ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:01:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfpyIUXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:31 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:31 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:31 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da9f9d6-52b5-4dc9-95bb-472fb9417166]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:31 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d8bfb0-a3f5-413a-86d8-98e96e0c205d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b] added
Aug 27 05:01:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d42f6db-371d-49e2-b4c1-190a2b94d94c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c640273b-beee-419a-a324-ca89fed59a22]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfpyIUXS {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfpyIUXS" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b4d63-ede2-4086-b5f1-c02f4992121c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfpyIUXS'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba406b-219a-4122-b7ed-46ba0bd632a3]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa985211-5f5e-4347-b505-df6da3fffa0c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a3193-05f3-4c88-bb14-723a430e07ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260]
Aug 27 05:01:31 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[061bef4a-76ef-4a5d-9e4a-cae2d6a73b40]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e583614-4113-45e7-8c27-5f9bd479c8d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[965148df-6e65-407d-b634-950d2a311e55]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfpyIUXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26532653136343931', 'path': '/dev/sdh'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532653136343931', 'path': '/dev/sdh'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'flavor' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:01:33 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:33 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:01:33 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:33 user nova-compute[72904]:   <serial>bf05f88a-ebf1-4638-8315-d653f1aeb26b</serial>
Aug 27 05:01:33 user nova-compute[72904]: </disk>
Aug 27 05:01:33 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No BDM found with device name hda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] No VIF found with MAC fa:16:3e:5c:fc:49, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:01:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYnIbGwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3853715e-fce2-4c7c-b2a1-b8875866e0e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a85f8113-1c12-437e-8f26-b54471cf9a70', 'serial': 'a85f8113-1c12-437e-8f26-b54471cf9a70'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '3853715e-fce2-4c7c-b2a1-b8875866e0e8', 'attached_at': '', 'detached_at': '', 'volume_id': '7a7745be-465a-413c-8fb8-1d87b2e641c5', 'serial'} {{(pid=72904) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYnIbGwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:40 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:40 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:40 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9557706-e8aa-4449-880e-2794ff6cb020]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:40 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f855f8-7495-4ca1-87c7-fa36444f3a16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70] added
Aug 27 05:01:40 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36c3f44-e67f-4daf-8a60-772100826795]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2be0590-290f-4780-919f-2ef8e5a9e328]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYnIbGwW {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aYnIbGwW" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[20121adb-9f12-422d-956e-6a435b4cd1af]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aYnIbGwW'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ac5bd-f73d-4ea5-991c-f52331ca01d9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e737c46e-3d82-4543-b5f7-fb1270c6447a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:40 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d1b39e-39c5-4a87-b2ec-7442d5ff0dd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260]
Aug 27 05:01:41 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:41 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c99409-8593-44e5-bdf2-5ea0f6ee8569]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[51162054-dca5-4906-b5ea-580d8c7d2119]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:41 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] HCTL ('42', '-', '-', 0) found on session 13 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a48f6952-45e9-4b40-9f81-707ae5189059 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.606s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1654f170-e8aa-4c36-95d9-2205c476eb94]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Searching for a device in session 13 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYnIbGwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:41 user nova-compute[72904]: INFO nova.compute.manager [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Detaching volume 87c45f08-29a9-4e19-bc81-025ea932c17c
Aug 27 05:01:41 user nova-compute[72904]: INFO nova.virt.block_device [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Attempting to driver detach volume 87c45f08-29a9-4e19-bc81-025ea932c17c from mountpoint /dev/sdc
Aug 27 05:01:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Attempting to detach device sdc from instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:41 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:41 user nova-compute[72904]:   <source dev="/dev/sdj"/>
Aug 27 05:01:41 user nova-compute[72904]:   <target dev="sdc" bus="scsi"/>
Aug 27 05:01:41 user nova-compute[72904]:   <serial>87c45f08-29a9-4e19-bc81-025ea932c17c</serial>
Aug 27 05:01:41 user nova-compute[72904]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 05:01:41 user nova-compute[72904]: </disk>
Aug 27 05:01:41 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Successfully detached device sdc from instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 from the persistent domain config.
Aug 27 05:01:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:01:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:41 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:41 user nova-compute[72904]:   <source dev="/dev/sdj"/>
Aug 27 05:01:41 user nova-compute[72904]:   <target dev="sdc" bus="scsi"/>
Aug 27 05:01:41 user nova-compute[72904]:   <serial>87c45f08-29a9-4e19-bc81-025ea932c17c</serial>
Aug 27 05:01:41 user nova-compute[72904]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 27 05:01:41 user nova-compute[72904]: </disk>
Aug 27 05:01:41 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693112502.1035693, b2fdad0c-92d6-4af6-b3aa-db138564bdf0 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:01:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Successfully detached device sdc from instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0 from the live domain config.
Aug 27 05:01:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKJbpiCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26362326463353162', 'path': '/dev/sdk'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362326463353162', 'path': '/dev/sdk'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.013s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG nova.objects.instance [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lazy-loading 'flavor' on Instance uuid 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd30fb35-591a-4384-81c1-fcf9ce3fcf92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d149d6-c0c4-4e42-9cbc-585d9378cd07]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91942b9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c'): ({'sdj'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Removing single pathed devices sdj {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d8209e-6e08-4874-ac7c-8f511139573f]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37f3cff-64da-4d2e-be07-d1014a262fe9]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Flushing IO for device /dev/sdj {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5107e6a-c05a-4994-bab5-8707ccace276]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf7c4c-e041-41e6-a187-3113aaf637bd]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] SCSI volumes sdj have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc80c606-325d-4fba-a651-a80244ff4cc8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbbc53c-59d7-40f3-8487-5ff181c55969]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260]
Aug 27 05:01:42 user nova-compute[72904]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c45f08-29a9-4e19-bc81-025ea932c17c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62fe366-5147-4a80-8a40-7ed6864fb69b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] <== disconnect_volume: return (339ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:01:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 27262976 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 27262976 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 27262976 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 27262976 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 96468992 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 104857600 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lazy-loading 'flavor' on Instance uuid 660b1c77-120e-40d5-b698-b89ec506caf3 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 149946368 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2c354241-6f15-42d7-9296-d4eaec3f4efb tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 20.698s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqCQlSsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:46 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:46 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:46 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e221f540-66c4-435e-8f54-adbe032dcd57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:01:46 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: INFO nova.compute.manager [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Detaching volume bf05f88a-ebf1-4638-8315-d653f1aeb26b
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.objects.instance [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lazy-loading 'flavor' on Instance uuid b2fdad0c-92d6-4af6-b3aa-db138564bdf0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de121e-219d-4c10-84ce-07e2114d53c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418] added
Aug 27 05:01:46 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e51225-37b0-4dd2-a29c-5adbe9331823]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-14bced4f-b7cf-4f9c-8341-935da8828bb1 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.930s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:46 user nova-compute[72904]: INFO nova.virt.block_device [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Attempting to driver detach volume bf05f88a-ebf1-4638-8315-d653f1aeb26b from mountpoint /dev/vdb
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6e570d-9055-40f8-88c0-bd9598396064]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqCQlSsI {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Attempting to detach device vdb from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:46 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:46 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:01:46 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:46 user nova-compute[72904]:   <serial>bf05f88a-ebf1-4638-8315-d653f1aeb26b</serial>
Aug 27 05:01:46 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 05:01:46 user nova-compute[72904]: </disk>
Aug 27 05:01:46 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nqCQlSsI" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[72700fcd-0f73-451e-8f90-e0b2277febac]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nqCQlSsI'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully detached device vdb from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the persistent domain config.
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:46 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:46 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:01:46 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:46 user nova-compute[72904]:   <serial>bf05f88a-ebf1-4638-8315-d653f1aeb26b</serial>
Aug 27 05:01:46 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 05:01:46 user nova-compute[72904]: </disk>
Aug 27 05:01:46 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 284164096 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bf04e6-c6ee-4218-b61c-c3068caa0762]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea8703b-f956-4e91-9d90-df43a84b5db6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d3438-78e8-4a15-94cb-c8591cfa07ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260]
Aug 27 05:01:46 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:46 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f27d9be-7712-4f1b-bd22-e85cdc7ce020]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddccdf23-541e-49c3-81fe-c9896914459d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:46 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef96e3f7-ab10-4238-93ce-e69d7529ab33]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:46 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 451936256 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693112507.1358743, e165c9ab-f2e0-43b4-bdcd-d92abd46c424 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:01:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully detached device vdb from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the live domain config.
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfpyIUXS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:47 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 595591168 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:47 user nova-compute[72904]: INFO nova.compute.manager [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Terminating instance
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqCQlSsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '26431666236613637', 'path': '/dev/sdj'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431666236613637', 'path': '/dev/sdj'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.749s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lazy-loading 'flavor' on Instance uuid 72995227-dd52-4b04-a119-41c34dc2e43b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3b869-0a0f-4909-b917-ec4073d50ad0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] attach device xml: <disk type="block" device="disk">
Aug 27 05:01:47 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:47 user nova-compute[72904]:   <source dev="/dev/sdj"/>
Aug 27 05:01:47 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:47 user nova-compute[72904]:   <serial>210a3691-de5d-4d1c-8a21-2d2302828418</serial>
Aug 27 05:01:47 user nova-compute[72904]: </disk>
Aug 27 05:01:47 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.063s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a991131-5b7a-49e5-9068-1b6e812dadd2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91942a72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b'): ({'sdh'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Removing single pathed devices sdh {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aea3c7e-5ef6-4926-a149-5c09affee9ba]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[847b82bd-add9-4139-8b5b-6f8d8ae2d7d7]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Flushing IO for device /dev/sdh {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbefab8-8da2-4393-be3e-c0e13b2d9f8d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 767557632 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.064s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e2426f-8b97-44ca-ba1e-c6858c4c4731]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] SCSI volumes sdh have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bacf8c-e15a-4b5c-bed8-848fe9d45a2e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-44f92095-2cde-49ce-9b91-07447e3365f4 req-0cb343d9-9e0a-4f9f-8f08-958742640b86 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-vif-unplugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-44f92095-2cde-49ce-9b91-07447e3365f4 req-0cb343d9-9e0a-4f9f-8f08-958742640b86 service nova] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-44f92095-2cde-49ce-9b91-07447e3365f4 req-0cb343d9-9e0a-4f9f-8f08-958742640b86 service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-44f92095-2cde-49ce-9b91-07447e3365f4 req-0cb343d9-9e0a-4f9f-8f08-958742640b86 service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-44f92095-2cde-49ce-9b91-07447e3365f4 req-0cb343d9-9e0a-4f9f-8f08-958742640b86 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] No waiting events found dispatching network-vif-unplugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-44f92095-2cde-49ce-9b91-07447e3365f4 req-0cb343d9-9e0a-4f9f-8f08-958742640b86 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-vif-unplugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --logout" returned: 0 in 0.115s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e691f563-da63-4b5f-aeee-3f5e770f7a93]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260]
Aug 27 05:01:48 user nova-compute[72904]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf05f88a-ebf1-4638-8315-d653f1aeb26b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.060s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5dcd50-9910-40d2-acd8-02c0b8512b5f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.495s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] <== disconnect_volume: return (1244ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 842006528 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] No VIF found with MAC fa:16:3e:26:b6:fa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:01:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Instance destroyed successfully.
Aug 27 05:01:48 user nova-compute[72904]: DEBUG nova.objects.instance [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lazy-loading 'resources' on Instance uuid b2fdad0c-92d6-4af6-b3aa-db138564bdf0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1833071487',display_name='tempest-AttachSCSIVolumeTestJSON-server-1833071487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1833071487',id=8,image_ref='ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhzoCvsJ9hF044kOEcF9VPtNh0HZSTODlMWaTE60QTBIBKxt2epYGZuroTneohQaseFt7Y/7Di/dqs/kWTYQn1k215JDclVJQn0oFUo07oEgVkPWcy+jciY5kxATaxqQw==',key_name='tempest-keypair-1833873001',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8631ec28830b4d03b2d50d5f1d74659d',ramdisk_id='',reservation_id='r-le2slgul',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ef9c351d-f6cf-464b-ab6d-d4e06ab8f7ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-13329697',owner_user_name='tempest-AttachSCSIVolumeTestJSON-13329697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e99acb565174514ac7fd967dcc349c8',uuid=b2fdad0c-92d6-4af6-b3aa-db138564bdf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Converting VIF {"id": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "address": "fa:16:3e:de:d1:ef", "network": {"id": "78f2587e-093c-476a-a5d0-e3066d7b3418", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-872431932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8631ec28830b4d03b2d50d5f1d74659d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d52553f-4d", "ovs_interfaceid": "6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7,network=Network(78f2587e-093c-476a-a5d0-e3066d7b3418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d52553f-4d') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG os_vif [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7,network=Network(78f2587e-093c-476a-a5d0-e3066d7b3418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d52553f-4d') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d52553f-4d, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:49 user nova-compute[72904]: INFO os_vif [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d1:ef,bridge_name='br-int',has_traffic_filtering=True,id=6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7,network=Network(78f2587e-093c-476a-a5d0-e3066d7b3418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d52553f-4d')
Aug 27 05:01:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Deleting instance files /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0_del
Aug 27 05:01:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Deletion of /opt/stack/data/nova/instances/b2fdad0c-92d6-4af6-b3aa-db138564bdf0_del complete
Aug 27 05:01:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-28bebc81-4b1a-412c-a44b-13df624c8082 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.756s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:49 user nova-compute[72904]: INFO nova.compute.manager [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 27 05:01:49 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 975175680 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.objects.instance [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'flavor' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] volume_snapshot_create: create_info: {'snapshot_id': '02ac991e-ef2b-46c0-b653-bf48a98e06c2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72904) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] snap xml: <domainsnapshot>
Aug 27 05:01:49 user nova-compute[72904]:   <disks>
Aug 27 05:01:49 user nova-compute[72904]:     <disk name="/dev/sdj" snapshot="external" type="file">
Aug 27 05:01:49 user nova-compute[72904]:       <source file="/dev/new_file"/>
Aug 27 05:01:49 user nova-compute[72904]:     </disk>
Aug 27 05:01:49 user nova-compute[72904]:     <disk name="vda" snapshot="no"/>
Aug 27 05:01:49 user nova-compute[72904]:   </disks>
Aug 27 05:01:49 user nova-compute[72904]: </domainsnapshot>
Aug 27 05:01:49 user nova-compute[72904]:  {{(pid=72904) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.objects.instance [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] Lazy-loading 'system_metadata' on Instance uuid 72995227-dd52-4b04-a119-41c34dc2e43b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:01:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-27a58342-ae2e-4d04-af93-96a1460f4309 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.469s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 05:01:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-705143d3-b26f-4949-9298-b66ab88d3b78 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] volume_snapshot_delete: delete_info: {'volume_id': '210a3691-de5d-4d1c-8a21-2d2302828418'} {{(pid=72904) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [None req-705143d3-b26f-4949-9298-b66ab88d3b78 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Traceback (most recent call last):
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     if delete_info['type'] != 'qcow2':
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] KeyError: 'type'
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] 
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Traceback (most recent call last):
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     rv = execute(f, *args, **kwargs)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     six.reraise(c, e, tb)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     raise value
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     rv = meth(*args, **kwargs)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] 
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Traceback (most recent call last):
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     self._volume_snapshot_create(context, instance, guest,
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     rv = execute(f, *args, **kwargs)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     six.reraise(c, e, tb)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     raise value
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     rv = meth(*args, **kwargs)
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 05:01:49 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] 
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:50 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [None req-705143d3-b26f-4949-9298-b66ab88d3b78 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-42d2475b-0e47-42f4-8a0e-6878c3d4e91c)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 02ac991e-ef2b-46c0-b653-bf48a98e06c2 could not be found.
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise value
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 02ac991e-ef2b-46c0-b653-bf48a98e06c2 could not be found. (HTTP 404) (Request-ID: req-436992b3-60c7-4aa5-8a75-d1cf3f4c0fd2)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 02ac991e-ef2b-46c0-b653-bf48a98e06c2 could not be found.
Aug 27 05:01:50 user nova-compute[72904]: ERROR nova.virt.libvirt.driver 
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a58734-22e6-4a50-a2bc-42820a4bb29a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server [None req-705143d3-b26f-4949-9298-b66ab88d3b78 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] Exception during message handling: KeyError: 'type'
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server 
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server [None req-4cb60b05-0633-493d-86b0-f7b899cd1c39 tempest-VolumesAssistedSnapshotsTest-1941070919 tempest-VolumesAssistedSnapshotsTest-1941070919-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 27 05:01:50 user nova-compute[72904]: ERROR oslo_messaging.rpc.server 
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2974ee-e223-4965-86ca-a0213bc8161e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91943f5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'): ({'sdi'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Removing single pathed devices sdi {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "interface-e165c9ab-f2e0-43b4-bdcd-d92abd46c424-7ab24d9d-287f-4d6c-bcd1-0e699e77a669" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "interface-e165c9ab-f2e0-43b4-bdcd-d92abd46c424-7ab24d9d-287f-4d6c-bcd1-0e699e77a669" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[224dc2a6-ff41-4bdc-b7f3-d9b7801fb73b]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'flavor' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd2f147-b157-4f89-8afd-3c70f9d42b73]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Flushing IO for device /dev/sdi {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1342835485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1342835485',id=7,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAciaZPZaCJGxXOOKlsbJ//xWfo4ksogNHfXMFLKueAWuieNVHgrMq6LO1M4N0Uyjna8u9qjgK5y9el1SbwjNLuHaSB/p3SpBWGFdOSomnz5j6eWVQ97zEHQWWQdnd6WfA==',key_name='tempest-keypair-109214732',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee8b8fa582214642ba95f4e685a954c8',ramdisk_id='',reservation_id='r-0e137ibn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-67395385',owner_user_name='tempest-TaggedAttachmentsTest-67395385-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad703280f584c9da9c6aeb37d328dc2',uuid=e165c9ab-f2e0-43b4-bdcd-d92abd46c424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converting VIF {"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5223efe4-ed93-4671-b36b-b24187bdf909]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:2e:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tap7ab24d9d-28"/></interface> {{(pid=72904) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:2e:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tap7ab24d9d-28"/></interface> {{(pid=72904) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Attempting to detach device tap7ab24d9d-28 from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] detach device xml: <interface type="ethernet">
Aug 27 05:01:50 user nova-compute[72904]:   <mac address="fa:16:3e:47:2e:f6"/>
Aug 27 05:01:50 user nova-compute[72904]:   <model type="virtio"/>
Aug 27 05:01:50 user nova-compute[72904]:   <mtu size="1442"/>
Aug 27 05:01:50 user nova-compute[72904]:   <target dev="tap7ab24d9d-28"/>
Aug 27 05:01:50 user nova-compute[72904]: </interface>
Aug 27 05:01:50 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:2e:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tap7ab24d9d-28"/></interface> {{(pid=72904) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:2e:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tap7ab24d9d-28"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 27 05:01:50 user nova-compute[72904]:   <name>instance-00000007</name>
Aug 27 05:01:50 user nova-compute[72904]:   <uuid>e165c9ab-f2e0-43b4-bdcd-d92abd46c424</uuid>
Aug 27 05:01:50 user nova-compute[72904]:   <metadata>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:01:50 user nova-compute[72904]:   <nova:package version="0.0.0"/>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:name>tempest-device-tagging-server-1342835485</nova:name>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:creationTime>2023-08-27 05:00:57</nova:creationTime>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:flavor name="m1.tiny">
Aug 27 05:01:50 user nova-compute[72904]:     <nova:memory>512</nova:memory>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:disk>1</nova:disk>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:swap>0</nova:swap>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:vcpus>1</nova:vcpus>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:flavor>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:owner>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:user uuid="aad703280f584c9da9c6aeb37d328dc2">tempest-TaggedAttachmentsTest-67395385-project-member</nova:user>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:project uuid="ee8b8fa582214642ba95f4e685a954c8">tempest-TaggedAttachmentsTest-67395385</nova:project>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:owner>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:ports>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:port uuid="64c8e17d-17d8-49b8-8264-b8b56c9c27c0">
Aug 27 05:01:50 user nova-compute[72904]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 05:01:50 user nova-compute[72904]:     </nova:port>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:port uuid="7ab24d9d-287f-4d6c-bcd1-0e699e77a669">
Aug 27 05:01:50 user nova-compute[72904]:       <nova:ip type="fixed" address="10.10.10.74" ipVersion="4"/>
Aug 27 05:01:50 user nova-compute[72904]:     </nova:port>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:ports>
Aug 27 05:01:50 user nova-compute[72904]: </nova:instance>
Aug 27 05:01:50 user nova-compute[72904]:   </metadata>
Aug 27 05:01:50 user nova-compute[72904]:   <memory unit='KiB'>524288</memory>
Aug 27 05:01:50 user nova-compute[72904]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 05:01:50 user nova-compute[72904]:   <vcpu placement='static'>1</vcpu>
Aug 27 05:01:50 user nova-compute[72904]:   <resource>
Aug 27 05:01:50 user nova-compute[72904]:     <partition>/machine</partition>
Aug 27 05:01:50 user nova-compute[72904]:   </resource>
Aug 27 05:01:50 user nova-compute[72904]:   <sysinfo type='smbios'>
Aug 27 05:01:50 user nova-compute[72904]:     <system>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='version'>0.0.0</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='serial'>e165c9ab-f2e0-43b4-bdcd-d92abd46c424</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='uuid'>e165c9ab-f2e0-43b4-bdcd-d92abd46c424</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='family'>Virtual Machine</entry>
Aug 27 05:01:50 user nova-compute[72904]:     </system>
Aug 27 05:01:50 user nova-compute[72904]:   </sysinfo>
Aug 27 05:01:50 user nova-compute[72904]:   <os>
Aug 27 05:01:50 user nova-compute[72904]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 05:01:50 user nova-compute[72904]:     <boot dev='hd'/>
Aug 27 05:01:50 user nova-compute[72904]:     <smbios mode='sysinfo'/>
Aug 27 05:01:50 user nova-compute[72904]:   </os>
Aug 27 05:01:50 user nova-compute[72904]:   <features>
Aug 27 05:01:50 user nova-compute[72904]:     <acpi/>
Aug 27 05:01:50 user nova-compute[72904]:     <apic/>
Aug 27 05:01:50 user nova-compute[72904]:     <vmcoreinfo state='on'/>
Aug 27 05:01:50 user nova-compute[72904]:   </features>
Aug 27 05:01:50 user nova-compute[72904]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 05:01:50 user nova-compute[72904]:     <model fallback='forbid'>Nehalem</model>
Aug 27 05:01:50 user nova-compute[72904]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 05:01:50 user nova-compute[72904]:     <feature policy='require' name='vme'/>
Aug 27 05:01:50 user nova-compute[72904]:     <feature policy='require' name='x2apic'/>
Aug 27 05:01:50 user nova-compute[72904]:     <feature policy='require' name='hypervisor'/>
Aug 27 05:01:50 user nova-compute[72904]:   </cpu>
Aug 27 05:01:50 user nova-compute[72904]:   <clock offset='utc'>
Aug 27 05:01:50 user nova-compute[72904]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 05:01:50 user nova-compute[72904]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 05:01:50 user nova-compute[72904]:     <timer name='hpet' present='no'/>
Aug 27 05:01:50 user nova-compute[72904]:   </clock>
Aug 27 05:01:50 user nova-compute[72904]:   <on_poweroff>destroy</on_poweroff>
Aug 27 05:01:50 user nova-compute[72904]:   <on_reboot>restart</on_reboot>
Aug 27 05:01:50 user nova-compute[72904]:   <on_crash>destroy</on_crash>
Aug 27 05:01:50 user nova-compute[72904]:   <devices>
Aug 27 05:01:50 user nova-compute[72904]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 05:01:50 user nova-compute[72904]:     <disk type='file' device='disk'>
Aug 27 05:01:50 user nova-compute[72904]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 05:01:50 user nova-compute[72904]:       <source file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk' index='2'/>
Aug 27 05:01:50 user nova-compute[72904]:       <backingStore type='file' index='3'>
Aug 27 05:01:50 user nova-compute[72904]:         <format type='raw'/>
Aug 27 05:01:50 user nova-compute[72904]:         <source file='/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2'/>
Aug 27 05:01:50 user nova-compute[72904]:         <backingStore/>
Aug 27 05:01:50 user nova-compute[72904]:       </backingStore>
Aug 27 05:01:50 user nova-compute[72904]:       <target dev='vda' bus='virtio'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='virtio-disk0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </disk>
Aug 27 05:01:50 user nova-compute[72904]:     <disk type='file' device='cdrom'>
Aug 27 05:01:50 user nova-compute[72904]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 05:01:50 user nova-compute[72904]:       <source file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.config' index='1'/>
Aug 27 05:01:50 user nova-compute[72904]:       <backingStore/>
Aug 27 05:01:50 user nova-compute[72904]:       <target dev='hda' bus='ide'/>
Aug 27 05:01:50 user nova-compute[72904]:       <readonly/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='ide0-0-0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </disk>
Aug 27 05:01:50 user nova-compute[72904]:     <controller type='usb' index='0' model='none'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='usb'/>
Aug 27 05:01:50 user nova-compute[72904]:     </controller>
Aug 27 05:01:50 user nova-compute[72904]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='pci.0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </controller>
Aug 27 05:01:50 user nova-compute[72904]:     <controller type='ide' index='0'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='ide'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 05:01:50 user nova-compute[72904]:     </controller>
Aug 27 05:01:50 user nova-compute[72904]:     <interface type='ethernet'>
Aug 27 05:01:50 user nova-compute[72904]:       <mac address='fa:16:3e:5c:fc:49'/>
Aug 27 05:01:50 user nova-compute[72904]:       <target dev='tap64c8e17d-17'/>
Aug 27 05:01:50 user nova-compute[72904]:       <model type='virtio'/>
Aug 27 05:01:50 user nova-compute[72904]:       <mtu size='1442'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='net0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </interface>
Aug 27 05:01:50 user nova-compute[72904]:     <interface type='ethernet'>
Aug 27 05:01:50 user nova-compute[72904]:       <mac address='fa:16:3e:47:2e:f6'/>
Aug 27 05:01:50 user nova-compute[72904]:       <target dev='tap7ab24d9d-28'/>
Aug 27 05:01:50 user nova-compute[72904]:       <model type='virtio'/>
Aug 27 05:01:50 user nova-compute[72904]:       <mtu size='1442'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='net1'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </interface>
Aug 27 05:01:50 user nova-compute[72904]:     <serial type='pty'>
Aug 27 05:01:50 user nova-compute[72904]:       <source path='/dev/pts/7'/>
Aug 27 05:01:50 user nova-compute[72904]:       <log file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/console.log' append='off'/>
Aug 27 05:01:50 user nova-compute[72904]:       <target type='isa-serial' port='0'>
Aug 27 05:01:50 user nova-compute[72904]:         <model name='isa-serial'/>
Aug 27 05:01:50 user nova-compute[72904]:       </target>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='serial0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </serial>
Aug 27 05:01:50 user nova-compute[72904]:     <console type='pty' tty='/dev/pts/7'>
Aug 27 05:01:50 user nova-compute[72904]:       <source path='/dev/pts/7'/>
Aug 27 05:01:50 user nova-compute[72904]:       <log file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/console.log' append='off'/>
Aug 27 05:01:50 user nova-compute[72904]:       <target type='serial' port='0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='serial0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </console>
Aug 27 05:01:50 user nova-compute[72904]:     <input type='mouse' bus='ps2'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='input0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </input>
Aug 27 05:01:50 user nova-compute[72904]:     <input type='keyboard' bus='ps2'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='input1'/>
Aug 27 05:01:50 user nova-compute[72904]:     </input>
Aug 27 05:01:50 user nova-compute[72904]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 27 05:01:50 user nova-compute[72904]:       <listen type='address' address='0.0.0.0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </graphics>
Aug 27 05:01:50 user nova-compute[72904]:     <audio id='1' type='none'/>
Aug 27 05:01:50 user nova-compute[72904]:     <video>
Aug 27 05:01:50 user nova-compute[72904]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='video0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </video>
Aug 27 05:01:50 user nova-compute[72904]:     <memballoon model='virtio'>
Aug 27 05:01:50 user nova-compute[72904]:       <stats period='10'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='balloon0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </memballoon>
Aug 27 05:01:50 user nova-compute[72904]:     <rng model='virtio'>
Aug 27 05:01:50 user nova-compute[72904]:       <backend model='random'>/dev/urandom</backend>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='rng0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </rng>
Aug 27 05:01:50 user nova-compute[72904]:   </devices>
Aug 27 05:01:50 user nova-compute[72904]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 05:01:50 user nova-compute[72904]:     <label>libvirt-e165c9ab-f2e0-43b4-bdcd-d92abd46c424</label>
Aug 27 05:01:50 user nova-compute[72904]:     <imagelabel>libvirt-e165c9ab-f2e0-43b4-bdcd-d92abd46c424</imagelabel>
Aug 27 05:01:50 user nova-compute[72904]:   </seclabel>
Aug 27 05:01:50 user nova-compute[72904]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 05:01:50 user nova-compute[72904]:     <label>+64055:+108</label>
Aug 27 05:01:50 user nova-compute[72904]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 05:01:50 user nova-compute[72904]:   </seclabel>
Aug 27 05:01:50 user nova-compute[72904]: </domain>
Aug 27 05:01:50 user nova-compute[72904]:  {{(pid=72904) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 05:01:50 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully detached device tap7ab24d9d-28 from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the persistent domain config.
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] (1/8): Attempting to detach device tap7ab24d9d-28 with device alias net1 from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] detach device xml: <interface type="ethernet">
Aug 27 05:01:50 user nova-compute[72904]:   <mac address="fa:16:3e:47:2e:f6"/>
Aug 27 05:01:50 user nova-compute[72904]:   <model type="virtio"/>
Aug 27 05:01:50 user nova-compute[72904]:   <mtu size="1442"/>
Aug 27 05:01:50 user nova-compute[72904]:   <target dev="tap7ab24d9d-28"/>
Aug 27 05:01:50 user nova-compute[72904]: </interface>
Aug 27 05:01:50 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.054s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[87550657-aa24-4414-ba8a-fd52a96ab280]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] SCSI volumes sdi have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-dbbe6c8a-003e-45df-ae44-b70ccc82c7ef req-5dbad86e-007d-4d1f-9c91-00f1a4f1bf97 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dbbe6c8a-003e-45df-ae44-b70ccc82c7ef req-5dbad86e-007d-4d1f-9c91-00f1a4f1bf97 service nova] Acquiring lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dbbe6c8a-003e-45df-ae44-b70ccc82c7ef req-5dbad86e-007d-4d1f-9c91-00f1a4f1bf97 service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dbbe6c8a-003e-45df-ae44-b70ccc82c7ef req-5dbad86e-007d-4d1f-9c91-00f1a4f1bf97 service nova] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-dbbe6c8a-003e-45df-ae44-b70ccc82c7ef req-5dbad86e-007d-4d1f-9c91-00f1a4f1bf97 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] No waiting events found dispatching network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:50 user nova-compute[72904]: WARNING nova.compute.manager [req-dbbe6c8a-003e-45df-ae44-b70ccc82c7ef req-5dbad86e-007d-4d1f-9c91-00f1a4f1bf97 service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received unexpected event network-vif-plugged-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 for instance with vm_state active and task_state deleting.
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa7e192-f3a4-49ee-bbe5-fddcb204caa4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcae5c6-b75d-4f61-b963-008ddd28c8df]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]
Aug 27 05:01:50 user nova-compute[72904]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:50 user nova-compute[72904]: INFO nova.compute.manager [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Detaching volume 210a3691-de5d-4d1c-8a21-2d2302828418
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4f974f-c2d2-4003-8689-8d3e13b74503]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] <== disconnect_volume: return (405ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:01:50 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Took 1.33 seconds to deallocate network for instance.
Aug 27 05:01:50 user nova-compute[72904]: INFO nova.virt.block_device [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Attempting to driver detach volume 210a3691-de5d-4d1c-8a21-2d2302828418 from mountpoint /dev/vdb
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Attempting to detach device vdb from instance 72995227-dd52-4b04-a119-41c34dc2e43b from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:50 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:50 user nova-compute[72904]:   <source dev="/dev/sdj"/>
Aug 27 05:01:50 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:50 user nova-compute[72904]:   <serial>210a3691-de5d-4d1c-8a21-2d2302828418</serial>
Aug 27 05:01:50 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:01:50 user nova-compute[72904]: </disk>
Aug 27 05:01:50 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYnIbGwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '3853715e-fce2-4c7c-b2a1-b8875866e0e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a85f8113-1c12-437e-8f26-b54471cf9a70', 'serial'} {{(pid=72904) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] swap_volume: removing Cinder connection for volume 7a7745be-465a-413c-8fb8-1d87b2e641c5 {{(pid=72904) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693112510.5414302, e165c9ab-f2e0-43b4-bdcd-d92abd46c424 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:01:50 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Successfully detached device vdb from instance 72995227-dd52-4b04-a119-41c34dc2e43b from the persistent domain config.
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72995227-dd52-4b04-a119-41c34dc2e43b from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] detach device xml: <disk type="block" device="disk">
Aug 27 05:01:50 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:01:50 user nova-compute[72904]:   <source dev="/dev/sdj"/>
Aug 27 05:01:50 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:01:50 user nova-compute[72904]:   <serial>210a3691-de5d-4d1c-8a21-2d2302828418</serial>
Aug 27 05:01:50 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:01:50 user nova-compute[72904]: </disk>
Aug 27 05:01:50 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Start waiting for the detach event from libvirt for device tap7ab24d9d-28 with device alias net1 for instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:47:2e:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tap7ab24d9d-28"/></interface> {{(pid=72904) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:47:2e:f6"/><model type="virtio"/><mtu size="1442"/><target dev="tap7ab24d9d-28"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 27 05:01:50 user nova-compute[72904]:   <name>instance-00000007</name>
Aug 27 05:01:50 user nova-compute[72904]:   <uuid>e165c9ab-f2e0-43b4-bdcd-d92abd46c424</uuid>
Aug 27 05:01:50 user nova-compute[72904]:   <metadata>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:01:50 user nova-compute[72904]:   <nova:package version="0.0.0"/>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:name>tempest-device-tagging-server-1342835485</nova:name>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:creationTime>2023-08-27 05:00:57</nova:creationTime>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:flavor name="m1.tiny">
Aug 27 05:01:50 user nova-compute[72904]:     <nova:memory>512</nova:memory>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:disk>1</nova:disk>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:swap>0</nova:swap>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:vcpus>1</nova:vcpus>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:flavor>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:owner>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:user uuid="aad703280f584c9da9c6aeb37d328dc2">tempest-TaggedAttachmentsTest-67395385-project-member</nova:user>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:project uuid="ee8b8fa582214642ba95f4e685a954c8">tempest-TaggedAttachmentsTest-67395385</nova:project>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:owner>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:ports>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:port uuid="64c8e17d-17d8-49b8-8264-b8b56c9c27c0">
Aug 27 05:01:50 user nova-compute[72904]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 05:01:50 user nova-compute[72904]:     </nova:port>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:port uuid="7ab24d9d-287f-4d6c-bcd1-0e699e77a669">
Aug 27 05:01:50 user nova-compute[72904]:       <nova:ip type="fixed" address="10.10.10.74" ipVersion="4"/>
Aug 27 05:01:50 user nova-compute[72904]:     </nova:port>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:ports>
Aug 27 05:01:50 user nova-compute[72904]: </nova:instance>
Aug 27 05:01:50 user nova-compute[72904]:   </metadata>
Aug 27 05:01:50 user nova-compute[72904]:   <memory unit='KiB'>524288</memory>
Aug 27 05:01:50 user nova-compute[72904]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 27 05:01:50 user nova-compute[72904]:   <vcpu placement='static'>1</vcpu>
Aug 27 05:01:50 user nova-compute[72904]:   <resource>
Aug 27 05:01:50 user nova-compute[72904]:     <partition>/machine</partition>
Aug 27 05:01:50 user nova-compute[72904]:   </resource>
Aug 27 05:01:50 user nova-compute[72904]:   <sysinfo type='smbios'>
Aug 27 05:01:50 user nova-compute[72904]:     <system>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='product'>OpenStack Nova</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='version'>0.0.0</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='serial'>e165c9ab-f2e0-43b4-bdcd-d92abd46c424</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='uuid'>e165c9ab-f2e0-43b4-bdcd-d92abd46c424</entry>
Aug 27 05:01:50 user nova-compute[72904]:       <entry name='family'>Virtual Machine</entry>
Aug 27 05:01:50 user nova-compute[72904]:     </system>
Aug 27 05:01:50 user nova-compute[72904]:   </sysinfo>
Aug 27 05:01:50 user nova-compute[72904]:   <os>
Aug 27 05:01:50 user nova-compute[72904]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 27 05:01:50 user nova-compute[72904]:     <boot dev='hd'/>
Aug 27 05:01:50 user nova-compute[72904]:     <smbios mode='sysinfo'/>
Aug 27 05:01:50 user nova-compute[72904]:   </os>
Aug 27 05:01:50 user nova-compute[72904]:   <features>
Aug 27 05:01:50 user nova-compute[72904]:     <acpi/>
Aug 27 05:01:50 user nova-compute[72904]:     <apic/>
Aug 27 05:01:50 user nova-compute[72904]:     <vmcoreinfo state='on'/>
Aug 27 05:01:50 user nova-compute[72904]:   </features>
Aug 27 05:01:50 user nova-compute[72904]:   <cpu mode='custom' match='exact' check='full'>
Aug 27 05:01:50 user nova-compute[72904]:     <model fallback='forbid'>Nehalem</model>
Aug 27 05:01:50 user nova-compute[72904]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 27 05:01:50 user nova-compute[72904]:     <feature policy='require' name='vme'/>
Aug 27 05:01:50 user nova-compute[72904]:     <feature policy='require' name='x2apic'/>
Aug 27 05:01:50 user nova-compute[72904]:     <feature policy='require' name='hypervisor'/>
Aug 27 05:01:50 user nova-compute[72904]:   </cpu>
Aug 27 05:01:50 user nova-compute[72904]:   <clock offset='utc'>
Aug 27 05:01:50 user nova-compute[72904]:     <timer name='pit' tickpolicy='delay'/>
Aug 27 05:01:50 user nova-compute[72904]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 27 05:01:50 user nova-compute[72904]:     <timer name='hpet' present='no'/>
Aug 27 05:01:50 user nova-compute[72904]:   </clock>
Aug 27 05:01:50 user nova-compute[72904]:   <on_poweroff>destroy</on_poweroff>
Aug 27 05:01:50 user nova-compute[72904]:   <on_reboot>restart</on_reboot>
Aug 27 05:01:50 user nova-compute[72904]:   <on_crash>destroy</on_crash>
Aug 27 05:01:50 user nova-compute[72904]:   <devices>
Aug 27 05:01:50 user nova-compute[72904]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 27 05:01:50 user nova-compute[72904]:     <disk type='file' device='disk'>
Aug 27 05:01:50 user nova-compute[72904]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 27 05:01:50 user nova-compute[72904]:       <source file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk' index='2'/>
Aug 27 05:01:50 user nova-compute[72904]:       <backingStore type='file' index='3'>
Aug 27 05:01:50 user nova-compute[72904]:         <format type='raw'/>
Aug 27 05:01:50 user nova-compute[72904]:         <source file='/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2'/>
Aug 27 05:01:50 user nova-compute[72904]:         <backingStore/>
Aug 27 05:01:50 user nova-compute[72904]:       </backingStore>
Aug 27 05:01:50 user nova-compute[72904]:       <target dev='vda' bus='virtio'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='virtio-disk0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </disk>
Aug 27 05:01:50 user nova-compute[72904]:     <disk type='file' device='cdrom'>
Aug 27 05:01:50 user nova-compute[72904]:       <driver name='qemu' type='raw' cache='none'/>
Aug 27 05:01:50 user nova-compute[72904]:       <source file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk.config' index='1'/>
Aug 27 05:01:50 user nova-compute[72904]:       <backingStore/>
Aug 27 05:01:50 user nova-compute[72904]:       <target dev='hda' bus='ide'/>
Aug 27 05:01:50 user nova-compute[72904]:       <readonly/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='ide0-0-0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </disk>
Aug 27 05:01:50 user nova-compute[72904]:     <controller type='usb' index='0' model='none'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='usb'/>
Aug 27 05:01:50 user nova-compute[72904]:     </controller>
Aug 27 05:01:50 user nova-compute[72904]:     <controller type='pci' index='0' model='pci-root'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='pci.0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </controller>
Aug 27 05:01:50 user nova-compute[72904]:     <controller type='ide' index='0'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='ide'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 27 05:01:50 user nova-compute[72904]:     </controller>
Aug 27 05:01:50 user nova-compute[72904]:     <interface type='ethernet'>
Aug 27 05:01:50 user nova-compute[72904]:       <mac address='fa:16:3e:5c:fc:49'/>
Aug 27 05:01:50 user nova-compute[72904]:       <target dev='tap64c8e17d-17'/>
Aug 27 05:01:50 user nova-compute[72904]:       <model type='virtio'/>
Aug 27 05:01:50 user nova-compute[72904]:       <mtu size='1442'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='net0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </interface>
Aug 27 05:01:50 user nova-compute[72904]:     <serial type='pty'>
Aug 27 05:01:50 user nova-compute[72904]:       <source path='/dev/pts/7'/>
Aug 27 05:01:50 user nova-compute[72904]:       <log file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/console.log' append='off'/>
Aug 27 05:01:50 user nova-compute[72904]:       <target type='isa-serial' port='0'>
Aug 27 05:01:50 user nova-compute[72904]:         <model name='isa-serial'/>
Aug 27 05:01:50 user nova-compute[72904]:       </target>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='serial0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </serial>
Aug 27 05:01:50 user nova-compute[72904]:     <console type='pty' tty='/dev/pts/7'>
Aug 27 05:01:50 user nova-compute[72904]:       <source path='/dev/pts/7'/>
Aug 27 05:01:50 user nova-compute[72904]:       <log file='/opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/console.log' append='off'/>
Aug 27 05:01:50 user nova-compute[72904]:       <target type='serial' port='0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='serial0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </console>
Aug 27 05:01:50 user nova-compute[72904]:     <input type='mouse' bus='ps2'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='input0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </input>
Aug 27 05:01:50 user nova-compute[72904]:     <input type='keyboard' bus='ps2'>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='input1'/>
Aug 27 05:01:50 user nova-compute[72904]:     </input>
Aug 27 05:01:50 user nova-compute[72904]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 27 05:01:50 user nova-compute[72904]:       <listen type='address' address='0.0.0.0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </graphics>
Aug 27 05:01:50 user nova-compute[72904]:     <audio id='1' type='none'/>
Aug 27 05:01:50 user nova-compute[72904]:     <video>
Aug 27 05:01:50 user nova-compute[72904]:       <model type='virtio' heads='1' primary='yes'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='video0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </video>
Aug 27 05:01:50 user nova-compute[72904]:     <memballoon model='virtio'>
Aug 27 05:01:50 user nova-compute[72904]:       <stats period='10'/>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='balloon0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </memballoon>
Aug 27 05:01:50 user nova-compute[72904]:     <rng model='virtio'>
Aug 27 05:01:50 user nova-compute[72904]:       <backend model='random'>/dev/urandom</backend>
Aug 27 05:01:50 user nova-compute[72904]:       <alias name='rng0'/>
Aug 27 05:01:50 user nova-compute[72904]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 27 05:01:50 user nova-compute[72904]:     </rng>
Aug 27 05:01:50 user nova-compute[72904]:   </devices>
Aug 27 05:01:50 user nova-compute[72904]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 27 05:01:50 user nova-compute[72904]:     <label>libvirt-e165c9ab-f2e0-43b4-bdcd-d92abd46c424</label>
Aug 27 05:01:50 user nova-compute[72904]:     <imagelabel>libvirt-e165c9ab-f2e0-43b4-bdcd-d92abd46c424</imagelabel>
Aug 27 05:01:50 user nova-compute[72904]:   </seclabel>
Aug 27 05:01:50 user nova-compute[72904]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 27 05:01:50 user nova-compute[72904]:     <label>+64055:+108</label>
Aug 27 05:01:50 user nova-compute[72904]:     <imagelabel>+64055:+108</imagelabel>
Aug 27 05:01:50 user nova-compute[72904]:   </seclabel>
Aug 27 05:01:50 user nova-compute[72904]: </domain>
Aug 27 05:01:50 user nova-compute[72904]:  {{(pid=72904) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 27 05:01:50 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully detached device tap7ab24d9d-28 from instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 from the live domain config.
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1342835485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1342835485',id=7,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAciaZPZaCJGxXOOKlsbJ//xWfo4ksogNHfXMFLKueAWuieNVHgrMq6LO1M4N0Uyjna8u9qjgK5y9el1SbwjNLuHaSB/p3SpBWGFdOSomnz5j6eWVQ97zEHQWWQdnd6WfA==',key_name='tempest-keypair-109214732',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee8b8fa582214642ba95f4e685a954c8',ramdisk_id='',reservation_id='r-0e137ibn',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-67395385',owner_user_name='tempest-TaggedAttachmentsTest-67395385-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad703280f584c9da9c6aeb37d328dc2',uuid=e165c9ab-f2e0-43b4-bdcd-d92abd46c424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converting VIF {"id": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "address": "fa:16:3e:47:2e:f6", "network": {"id": "35cdb8d3-ac19-4c17-860f-9936e5474e3a", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-693899780", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.74", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ab24d9d-28", "ovs_interfaceid": "7ab24d9d-287f-4d6c-bcd1-0e699e77a669", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG os_vif [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ab24d9d-28, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:50 user nova-compute[72904]: INFO os_vif [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:2e:f6,bridge_name='br-int',has_traffic_filtering=True,id=7ab24d9d-287f-4d6c-bcd1-0e699e77a669,network=Network(35cdb8d3-ac19-4c17-860f-9936e5474e3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ab24d9d-28')
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:01:50 user nova-compute[72904]:   <nova:package version="0.0.0"/>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:name>tempest-device-tagging-server-1342835485</nova:name>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:creationTime>2023-08-27 05:01:50</nova:creationTime>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:flavor name="m1.tiny">
Aug 27 05:01:50 user nova-compute[72904]:     <nova:memory>512</nova:memory>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:disk>1</nova:disk>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:swap>0</nova:swap>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:vcpus>1</nova:vcpus>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:flavor>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:owner>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:user uuid="aad703280f584c9da9c6aeb37d328dc2">tempest-TaggedAttachmentsTest-67395385-project-member</nova:user>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:project uuid="ee8b8fa582214642ba95f4e685a954c8">tempest-TaggedAttachmentsTest-67395385</nova:project>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:owner>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:01:50 user nova-compute[72904]:   <nova:ports>
Aug 27 05:01:50 user nova-compute[72904]:     <nova:port uuid="64c8e17d-17d8-49b8-8264-b8b56c9c27c0">
Aug 27 05:01:50 user nova-compute[72904]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 05:01:50 user nova-compute[72904]:     </nova:port>
Aug 27 05:01:50 user nova-compute[72904]:   </nova:ports>
Aug 27 05:01:50 user nova-compute[72904]: </nova:instance>
Aug 27 05:01:50 user nova-compute[72904]:  {{(pid=72904) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:01:50 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693112511.0466273, 72995227-dd52-4b04-a119-41c34dc2e43b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72995227-dd52-4b04-a119-41c34dc2e43b {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:01:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Successfully detached device vdb from instance 72995227-dd52-4b04-a119-41c34dc2e43b from the live domain config.
Aug 27 05:01:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nqCQlSsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:51 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Deleted allocations for instance b2fdad0c-92d6-4af6-b3aa-db138564bdf0
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf497a-18e3-49c9-a97e-2347d925a437]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb51410c-ca32-47c8-8a93-24074eb9d409]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:01:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7dcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418'): ({'sdj'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Removing single pathed devices sdj {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a401aa-c15b-48c7-aa75-73fb7ec7ae7c]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e4bc8c-ea77-4d1e-9a92-d5ca867ac35c]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Flushing IO for device /dev/sdj {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cb89a9-45d5-4e72-8dae-e7be9a3694a9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8eaf0ccc-8cab-4e6b-92b2-0a46910c2383 tempest-AttachSCSIVolumeTestJSON-13329697 tempest-AttachSCSIVolumeTestJSON-13329697-project-member] Lock "b2fdad0c-92d6-4af6-b3aa-db138564bdf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.486s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.064s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce750ae-8530-44fa-87d8-f350f21d11af]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] SCSI volumes sdj have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a00c45c-10d1-40d3-a33b-f02f4d39bb9e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e5d3e-467b-4006-9b62-66b27f1b5de8]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260]
Aug 27 05:01:51 user nova-compute[72904]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418, portal: 172.16.0.220,3260] successful.
Aug 27 05:01:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:210a3691-de5d-4d1c-8a21-2d2302828418 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4d5125-eef0-4436-882c-976026e50ccf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] <== disconnect_volume: return (371ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquired lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] swap_volume: Updating volume 7a7745be-465a-413c-8fb8-1d87b2e641c5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "aYnIbGwW", "auth_password": "5QkftArYKUO7S6", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "a85f8113-1c12-437e-8f26-b54471cf9a70"}, "status": "reserved", "instance": "3853715e-fce2-4c7c-b2a1-b8875866e0e8", "attached_at": "", "detached_at": "", "volume_id": "a85f8113-1c12-437e-8f26-b54471cf9a70", "serial": "a85f8113-1c12-437e-8f26-b54471cf9a70"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a85f8113-1c12-437e-8f26-b54471cf9a70', 'no_device': None, 'attachment_id': '6ae95cdc-b375-41ff-b89c-f948a1cb617e'} {{(pid=72904) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-be69513c-49d0-4918-a327-633f97f571e1 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 25.580s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:51 user nova-compute[72904]: INFO nova.network.neutron [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Port 7ab24d9d-287f-4d6c-bcd1-0e699e77a669 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 27 05:01:51 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating instance_info_cache with network_info: [{"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Releasing lock "refresh_cache-e165c9ab-f2e0-43b4-bdcd-d92abd46c424" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:01:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d5916c35-509f-4dbc-8fa8-47c0caddfd0b tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "interface-e165c9ab-f2e0-43b4-bdcd-d92abd46c424-7ab24d9d-287f-4d6c-bcd1-0e699e77a669" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.823s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG os_brick.utils [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b75123-64a7-4f0e-abbf-cb78e98a1264]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c965f8-bb65-4689-9528-674437aa8179]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b20d860-073e-483c-b7d3-abb97fc2e391]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b00888-41f1-45e4-8025-e29fea8e29e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:01:52 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b712238-acba-497b-9728-b74365431c4f]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG os_brick.utils [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Received event network-vif-deleted-6d52553f-4d1b-4e57-bc6f-e3e4cf91dad7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-unplugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-unplugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:52 user nova-compute[72904]: WARNING nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received unexpected event network-vif-unplugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 for instance with vm_state active and task_state None.
Aug 27 05:01:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:01:52 user nova-compute[72904]: WARNING nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received unexpected event network-vif-plugged-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 for instance with vm_state active and task_state None.
Aug 27 05:01:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f4a12dc-b996-419b-a7d8-f541655c06d9 req-e6967208-6034-4914-ae3b-77840b83f08a service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-deleted-7ab24d9d-287f-4d6c-bcd1-0e699e77a669 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lazy-loading 'flavor' on Instance uuid 72995227-dd52-4b04-a119-41c34dc2e43b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:01:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4d382cc7-d9f7-41a6-842b-0ed406b0fca8 tempest-VolumesAssistedSnapshotsTest-1193678060 tempest-VolumesAssistedSnapshotsTest-1193678060-project-admin] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.048s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:01:52 user nova-compute[72904]: INFO nova.compute.manager [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Swapping volume a85f8113-1c12-437e-8f26-b54471cf9a70 for 7a7745be-465a-413c-8fb8-1d87b2e641c5
Aug 27 05:01:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:01:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:03 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112508.9687665, b2fdad0c-92d6-4af6-b3aa-db138564bdf0 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:03 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] VM Stopped (Lifecycle Event)
Aug 27 05:02:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1601dc16-3eb3-4005-ad90-279ebe0f5f60 None None] [instance: b2fdad0c-92d6-4af6-b3aa-db138564bdf0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3853715e-fce2-4c7c-b2a1-b8875866e0e8', 'attached_at': '', 'detached_at': '', 'volume_id': '7a7745be-465a-413c-8fb8-1d87b2e641c5', 'serial': '7a7745be-465a-413c-8fb8-1d87b2e641c5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYnIbGwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'a85f8113-1c12-437e-8f26-b54471cf9a70'}, 'status': 'reserved', 'instance': '3853715e-fce2-4c7c-b2a1-b8875866e0e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a85f8113-1c12-437e-8f26-b54471cf9a70', 'serial'} {{(pid=72904) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:05 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad95a19b-9815-4a15-94a0-df7c63717763]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:02:05 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc81aad4-0099-4ea7-8a6e-7d25a6ff13ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5] added
Aug 27 05:02:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[67abdaa1-c7e9-4e3e-adb9-1db7fa747edf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6fbc5b-1e44-4e37-b239-9ddbcfcf5735]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJcdsBST {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJcdsBST" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ce7410-e02f-4098-9eeb-5690df35ad1a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJcdsBST'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a5fcbf-f804-442d-84db-4597392875b2]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7661f658-c9ca-485c-9333-e94a84607ecd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6262cd7e-b526-4e34-be41-ef0a6bbf2f60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]
Aug 27 05:02:05 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9627996-4dc6-41fb-8604-1f3c0013cefe]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[56823b84-e02e-4b0d-a004-952827acb488]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] HCTL ('39', '-', '-', 0) found on session 15 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[62302635-9d18-48ce-a076-05871c88c5eb]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Searching for a device in session 15 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:02:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:02:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.467s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23562323835356566', 'path': '/dev/sdh'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562323835356566', 'path': '/dev/sdh'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:02:06 user nova-compute[72904]: DEBUG nova.objects.instance [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lazy-loading 'flavor' on Instance uuid 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 142606336 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 300941312 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 439353344 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 563085312 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 622854144 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 917504000 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aYnIbGwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'a85f8113-1c12-437e-8f26-b54471cf9a70'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:11 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6303adce-03e8-4684-9939-e253efe368a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[24370656-bed6-4c33-8c66-e0ff26de4ac7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91942bb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70'): ({'sdk'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Removing single pathed devices sdk {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2554f5fb-ad5e-473a-8c0d-4e18091c3c90]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[263633ae-6f93-4392-96f4-2c77e5c8c29f]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Flushing IO for device /dev/sdk {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e664a2cd-0bbe-4f09-89a7-531e71833d82]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa4db1c-bbc5-48c6-bf9a-70699db108f1]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] SCSI volumes sdk have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c988e630-3849-4d99-9e81-eeab3cc34ecd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "93251700-8080-409f-8867-556781572964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "93251700-8080-409f-8867-556781572964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "93251700-8080-409f-8867-556781572964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "93251700-8080-409f-8867-556781572964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "93251700-8080-409f-8867-556781572964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:11 user nova-compute[72904]: INFO nova.compute.manager [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Terminating instance
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78d38c8-1c01-4bfd-b29b-9441715bdaf9]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260]
Aug 27 05:02:11 user nova-compute[72904]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a85f8113-1c12-437e-8f26-b54471cf9a70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[17011b47-7edd-4473-9265-416191925165]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] <== disconnect_volume: return (308ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '3853715e-fce2-4c7c-b2a1-b8875866e0e8', 'attached_at': '', 'detached_at': '', 'volume_id': '7a7745be-465a-413c-8fb8-1d87b2e641c5', 'serial'} {{(pid=72904) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] swap_volume: removing Cinder connection for volume a85f8113-1c12-437e-8f26-b54471cf9a70 {{(pid=72904) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-bb19cbe7-8366-4713-980d-0a89b60df83a req-35b74073-cc83-48b7-ad49-4e87ae6d921d service nova] [instance: 93251700-8080-409f-8867-556781572964] Received event network-vif-unplugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bb19cbe7-8366-4713-980d-0a89b60df83a req-35b74073-cc83-48b7-ad49-4e87ae6d921d service nova] Acquiring lock "93251700-8080-409f-8867-556781572964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bb19cbe7-8366-4713-980d-0a89b60df83a req-35b74073-cc83-48b7-ad49-4e87ae6d921d service nova] Lock "93251700-8080-409f-8867-556781572964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bb19cbe7-8366-4713-980d-0a89b60df83a req-35b74073-cc83-48b7-ad49-4e87ae6d921d service nova] Lock "93251700-8080-409f-8867-556781572964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-bb19cbe7-8366-4713-980d-0a89b60df83a req-35b74073-cc83-48b7-ad49-4e87ae6d921d service nova] [instance: 93251700-8080-409f-8867-556781572964] No waiting events found dispatching network-vif-unplugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-bb19cbe7-8366-4713-980d-0a89b60df83a req-35b74073-cc83-48b7-ad49-4e87ae6d921d service nova] [instance: 93251700-8080-409f-8867-556781572964] Received event network-vif-unplugged-e02e7f98-7145-4cf7-be99-776132b0cab1 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:12 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 93251700-8080-409f-8867-556781572964] Instance destroyed successfully.
Aug 27 05:02:12 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lazy-loading 'resources' on Instance uuid 93251700-8080-409f-8867-556781572964 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:00:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-209348806',display_name='tempest-ServersNegativeTestJSON-server-209348806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-209348806',id=12,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='639c2163be4446719e85d97984980e7f',ramdisk_id='',reservation_id='r-dt8nggxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1301649002',owner_user_name='tempest-ServersNegativeTestJSON-1301649002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:33Z,user_data=None,user_id='fcd62b49154b47d58be14586316fc1a3',uuid=93251700-8080-409f-8867-556781572964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converting VIF {"id": "e02e7f98-7145-4cf7-be99-776132b0cab1", "address": "fa:16:3e:8e:ed:77", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape02e7f98-71", "ovs_interfaceid": "e02e7f98-7145-4cf7-be99-776132b0cab1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:77,bridge_name='br-int',has_traffic_filtering=True,id=e02e7f98-7145-4cf7-be99-776132b0cab1,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02e7f98-71') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG os_vif [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:77,bridge_name='br-int',has_traffic_filtering=True,id=e02e7f98-7145-4cf7-be99-776132b0cab1,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02e7f98-71') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape02e7f98-71, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:12 user nova-compute[72904]: INFO os_vif [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:ed:77,bridge_name='br-int',has_traffic_filtering=True,id=e02e7f98-7145-4cf7-be99-776132b0cab1,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape02e7f98-71')
Aug 27 05:02:12 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Deleting instance files /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964_del
Aug 27 05:02:12 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Deletion of /opt/stack/data/nova/instances/93251700-8080-409f-8867-556781572964_del complete
Aug 27 05:02:12 user nova-compute[72904]: INFO nova.compute.manager [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 93251700-8080-409f-8867-556781572964] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 05:02:12 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 93251700-8080-409f-8867-556781572964] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 93251700-8080-409f-8867-556781572964] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] swap_volume: Updating volume a85f8113-1c12-437e-8f26-b54471cf9a70 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "gJcdsBST", "auth_password": "euOCQmroM5c20j", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "7a7745be-465a-413c-8fb8-1d87b2e641c5"}, "status": "reserved", "instance": "3853715e-fce2-4c7c-b2a1-b8875866e0e8", "attached_at": "", "detached_at": "", "volume_id": "7a7745be-465a-413c-8fb8-1d87b2e641c5", "serial": "7a7745be-465a-413c-8fb8-1d87b2e641c5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7a7745be-465a-413c-8fb8-1d87b2e641c5', 'no_device': None, 'attachment_id': '6796a055-a13a-40a9-b74b-d8de790360ed'} {{(pid=72904) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 27 05:02:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7d3dc893-11a1-4c7c-b439-3bf9470b6490 tempest-TestVolumeSwap-1054587662 tempest-TestVolumeSwap-1054587662-project-admin] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.533s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:13 user nova-compute[72904]: INFO nova.compute.manager [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Detaching volume 7a7745be-465a-413c-8fb8-1d87b2e641c5
Aug 27 05:02:13 user nova-compute[72904]: INFO nova.virt.block_device [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Attempting to driver detach volume 7a7745be-465a-413c-8fb8-1d87b2e641c5 from mountpoint /dev/vdb
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Attempting to detach device vdb from instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:02:13 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:02:13 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:02:13 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:02:13 user nova-compute[72904]:   <serial>7a7745be-465a-413c-8fb8-1d87b2e641c5</serial>
Aug 27 05:02:13 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:02:13 user nova-compute[72904]: </disk>
Aug 27 05:02:13 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:02:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Successfully detached device vdb from instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 from the persistent domain config.
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:02:13 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:02:13 user nova-compute[72904]:   <source dev="/dev/sdh"/>
Aug 27 05:02:13 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:02:13 user nova-compute[72904]:   <serial>7a7745be-465a-413c-8fb8-1d87b2e641c5</serial>
Aug 27 05:02:13 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:02:13 user nova-compute[72904]: </disk>
Aug 27 05:02:13 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 93251700-8080-409f-8867-556781572964] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-80d831e8-b50b-454f-b11c-7fab8bc24ba1 req-3b61a76b-f216-42f2-a727-a80aa0fcaa2f service nova] [instance: 93251700-8080-409f-8867-556781572964] Received event network-vif-deleted-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:13 user nova-compute[72904]: INFO nova.compute.manager [req-80d831e8-b50b-454f-b11c-7fab8bc24ba1 req-3b61a76b-f216-42f2-a727-a80aa0fcaa2f service nova] [instance: 93251700-8080-409f-8867-556781572964] Neutron deleted interface e02e7f98-7145-4cf7-be99-776132b0cab1; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.network.neutron [req-80d831e8-b50b-454f-b11c-7fab8bc24ba1 req-3b61a76b-f216-42f2-a727-a80aa0fcaa2f service nova] [instance: 93251700-8080-409f-8867-556781572964] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:13 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 93251700-8080-409f-8867-556781572964] Took 1.00 seconds to deallocate network for instance.
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-80d831e8-b50b-454f-b11c-7fab8bc24ba1 req-3b61a76b-f216-42f2-a727-a80aa0fcaa2f service nova] [instance: 93251700-8080-409f-8867-556781572964] Detach interface failed, port_id=e02e7f98-7145-4cf7-be99-776132b0cab1, reason: Instance 93251700-8080-409f-8867-556781572964 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693112533.8249912, 3853715e-fce2-4c7c-b2a1-b8875866e0e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:02:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Successfully detached device vdb from instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 from the live domain config.
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJcdsBST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '7a7745be-465a-413c-8fb8-1d87b2e641c5'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:13 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e83f586-f3c6-476c-8e74-d2aacefcc37a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:13 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Deleted allocations for instance 93251700-8080-409f-8867-556781572964
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b4285-be2f-4907-9596-cddb103b5f5b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91942b97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5'): ({'sdh'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Removing single pathed devices sdh {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c28c60-9e9f-42c8-86d3-b4ccc23279f8]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c243822b-b785-4246-bfa2-b154544f5427]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Flushing IO for device /dev/sdh {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1926b9-175c-4f85-a849-a4f0e07c950c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-003daaba-423a-40b3-9b68-f09bec8c4383 req-262543b2-af03-4097-849a-0d9c10e724bd service nova] [instance: 93251700-8080-409f-8867-556781572964] Received event network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-003daaba-423a-40b3-9b68-f09bec8c4383 req-262543b2-af03-4097-849a-0d9c10e724bd service nova] Acquiring lock "93251700-8080-409f-8867-556781572964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-003daaba-423a-40b3-9b68-f09bec8c4383 req-262543b2-af03-4097-849a-0d9c10e724bd service nova] Lock "93251700-8080-409f-8867-556781572964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-003daaba-423a-40b3-9b68-f09bec8c4383 req-262543b2-af03-4097-849a-0d9c10e724bd service nova] Lock "93251700-8080-409f-8867-556781572964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-003daaba-423a-40b3-9b68-f09bec8c4383 req-262543b2-af03-4097-849a-0d9c10e724bd service nova] [instance: 93251700-8080-409f-8867-556781572964] No waiting events found dispatching network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:13 user nova-compute[72904]: WARNING nova.compute.manager [req-003daaba-423a-40b3-9b68-f09bec8c4383 req-262543b2-af03-4097-849a-0d9c10e724bd service nova] [instance: 93251700-8080-409f-8867-556781572964] Received unexpected event network-vif-plugged-e02e7f98-7145-4cf7-be99-776132b0cab1 for instance with vm_state deleted and task_state None.
Aug 27 05:02:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b1797292-2caf-4756-be71-8e6c684026f2 tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "93251700-8080-409f-8867-556781572964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeeb500-a562-490c-ba86-2fa814c06ff8]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] SCSI volumes sdh have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98719cf-eeff-4c52-936a-86e3b2a4de33]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f676369-4a33-4bd2-a64b-d4d1f0c008b1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260]
Aug 27 05:02:14 user nova-compute[72904]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:14 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a7745be-465a-413c-8fb8-1d87b2e641c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[791e1604-1331-4b0b-8e75-8c2b0b95a6b5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] <== disconnect_volume: return (354ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:15 user nova-compute[72904]: DEBUG nova.objects.instance [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lazy-loading 'flavor' on Instance uuid 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7c1a2f5a-1157-494e-a9e2-a2fe5f7b7fc5 tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.853s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:02:17 user nova-compute[72904]: INFO nova.compute.claims [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Claim successful on node user
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:02:17 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.policy [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3aa245527faf42099b0bcefbad8e9a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d22ddf3716486784e9bc8d39420d63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:02:17 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Creating image(s)
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "/opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "/opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk 1073741824" returned: 0 in 0.050s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Successfully created port: 90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Cannot resize image /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Ensure instance console log exists: /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Successfully updated port: 90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "refresh_cache-6c6e4a49-6715-4e80-b593-de2b720ae255" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquired lock "refresh_cache-6c6e4a49-6715-4e80-b593-de2b720ae255" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-changed-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Refreshing instance network info cache due to event network-changed-90ef0071-ce6b-47e3-98ec-f47380c43632. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:02:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] Acquiring lock "refresh_cache-6c6e4a49-6715-4e80-b593-de2b720ae255" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Updating instance_info_cache with network_info: [{"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Releasing lock "refresh_cache-6c6e4a49-6715-4e80-b593-de2b720ae255" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Instance network_info: |[{"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] Acquired lock "refresh_cache-6c6e4a49-6715-4e80-b593-de2b720ae255" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Refreshing network info cache for port 90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Start _get_guest_xml network_info=[{"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:02:19 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:02:19 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1469146538',display_name='tempest-VolumesAdminNegativeTest-server-1469146538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1469146538',id=13,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97d22ddf3716486784e9bc8d39420d63',ramdisk_id='',reservation_id='r-42v7siq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1562447872',owner_user_name='tempest-VolumesAdminNegativeTest-1562447872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:02:18Z,user_data=None,user_id='3aa245527faf42099b0bcefbad8e9a13',uuid=6c6e4a49-6715-4e80-b593-de2b720ae255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converting VIF {"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:3c,bridge_name='br-int',has_traffic_filtering=True,id=90ef0071-ce6b-47e3-98ec-f47380c43632,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ef0071-ce') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c6e4a49-6715-4e80-b593-de2b720ae255 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:02:19 user nova-compute[72904]:   <uuid>6c6e4a49-6715-4e80-b593-de2b720ae255</uuid>
Aug 27 05:02:19 user nova-compute[72904]:   <name>instance-0000000d</name>
Aug 27 05:02:19 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:02:19 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:02:19 user nova-compute[72904]:   <metadata>
Aug 27 05:02:19 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:02:19 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:02:19 user nova-compute[72904]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1469146538</nova:name>
Aug 27 05:02:19 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:02:19</nova:creationTime>
Aug 27 05:02:19 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:02:19 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:02:19 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:02:19 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:02:19 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:02:19 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:02:19 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:02:19 user nova-compute[72904]:       <nova:owner>
Aug 27 05:02:19 user nova-compute[72904]:         <nova:user uuid="3aa245527faf42099b0bcefbad8e9a13">tempest-VolumesAdminNegativeTest-1562447872-project-member</nova:user>
Aug 27 05:02:19 user nova-compute[72904]:         <nova:project uuid="97d22ddf3716486784e9bc8d39420d63">tempest-VolumesAdminNegativeTest-1562447872</nova:project>
Aug 27 05:02:19 user nova-compute[72904]:       </nova:owner>
Aug 27 05:02:19 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:02:19 user nova-compute[72904]:       <nova:ports>
Aug 27 05:02:19 user nova-compute[72904]:         <nova:port uuid="90ef0071-ce6b-47e3-98ec-f47380c43632">
Aug 27 05:02:19 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:02:19 user nova-compute[72904]:         </nova:port>
Aug 27 05:02:19 user nova-compute[72904]:       </nova:ports>
Aug 27 05:02:19 user nova-compute[72904]:     </nova:instance>
Aug 27 05:02:19 user nova-compute[72904]:   </metadata>
Aug 27 05:02:19 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:02:19 user nova-compute[72904]:     <system>
Aug 27 05:02:19 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:02:19 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:02:19 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:02:19 user nova-compute[72904]:       <entry name="serial">6c6e4a49-6715-4e80-b593-de2b720ae255</entry>
Aug 27 05:02:19 user nova-compute[72904]:       <entry name="uuid">6c6e4a49-6715-4e80-b593-de2b720ae255</entry>
Aug 27 05:02:19 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:02:19 user nova-compute[72904]:     </system>
Aug 27 05:02:19 user nova-compute[72904]:   </sysinfo>
Aug 27 05:02:19 user nova-compute[72904]:   <os>
Aug 27 05:02:19 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:02:19 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:02:19 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:02:19 user nova-compute[72904]:   </os>
Aug 27 05:02:19 user nova-compute[72904]:   <features>
Aug 27 05:02:19 user nova-compute[72904]:     <acpi/>
Aug 27 05:02:19 user nova-compute[72904]:     <apic/>
Aug 27 05:02:19 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:02:19 user nova-compute[72904]:   </features>
Aug 27 05:02:19 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:02:19 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:02:19 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:02:19 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:02:19 user nova-compute[72904]:   </clock>
Aug 27 05:02:19 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:02:19 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:02:19 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:02:19 user nova-compute[72904]:   </cpu>
Aug 27 05:02:19 user nova-compute[72904]:   <devices>
Aug 27 05:02:19 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:02:19 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:02:19 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk"/>
Aug 27 05:02:19 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:02:19 user nova-compute[72904]:     </disk>
Aug 27 05:02:19 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:02:19 user nova-compute[72904]:       <mac address="fa:16:3e:14:db:3c"/>
Aug 27 05:02:19 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:02:19 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:02:19 user nova-compute[72904]:       <target dev="tap90ef0071-ce"/>
Aug 27 05:02:19 user nova-compute[72904]:     </interface>
Aug 27 05:02:19 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:02:19 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/console.log" append="off"/>
Aug 27 05:02:19 user nova-compute[72904]:     </serial>
Aug 27 05:02:19 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:02:19 user nova-compute[72904]:     <video>
Aug 27 05:02:19 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:02:19 user nova-compute[72904]:     </video>
Aug 27 05:02:19 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:02:19 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:02:19 user nova-compute[72904]:     </rng>
Aug 27 05:02:19 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:02:19 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:02:19 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:02:19 user nova-compute[72904]:     </memballoon>
Aug 27 05:02:19 user nova-compute[72904]:   </devices>
Aug 27 05:02:19 user nova-compute[72904]: </domain>
Aug 27 05:02:19 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1469146538',display_name='tempest-VolumesAdminNegativeTest-server-1469146538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1469146538',id=13,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97d22ddf3716486784e9bc8d39420d63',ramdisk_id='',reservation_id='r-42v7siq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1562447872',owner_user_name='tempest-VolumesAdminNegativeTest-1562447872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:02:18Z,user_data=None,user_id='3aa245527faf42099b0bcefbad8e9a13',uuid=6c6e4a49-6715-4e80-b593-de2b720ae255,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converting VIF {"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:3c,bridge_name='br-int',has_traffic_filtering=True,id=90ef0071-ce6b-47e3-98ec-f47380c43632,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ef0071-ce') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG os_vif [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:3c,bridge_name='br-int',has_traffic_filtering=True,id=90ef0071-ce6b-47e3-98ec-f47380c43632,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ef0071-ce') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90ef0071-ce, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90ef0071-ce, col_values=(('external_ids', {'iface-id': '90ef0071-ce6b-47e3-98ec-f47380c43632', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:db:3c', 'vm-uuid': '6c6e4a49-6715-4e80-b593-de2b720ae255'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:19 user nova-compute[72904]: INFO os_vif [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:3c,bridge_name='br-int',has_traffic_filtering=True,id=90ef0071-ce6b-47e3-98ec-f47380c43632,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ef0071-ce')
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] No VIF found with MAC fa:16:3e:14:db:3c, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Updated VIF entry in instance network info cache for port 90ef0071-ce6b-47e3-98ec-f47380c43632. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Updating instance_info_cache with network_info: [{"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'flavor' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8542b94e-7397-4cfa-b0a5-3194e27632ac req-3b89872d-0cb2-4a01-babc-1f32662b006f service nova] Releasing lock "refresh_cache-6c6e4a49-6715-4e80-b593-de2b720ae255" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:20 user nova-compute[72904]: INFO nova.compute.manager [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Attaching volume 4003285f-2c5d-4cda-82f6-d0e46fdc8672 to /dev/vdb
Aug 27 05:02:20 user nova-compute[72904]: DEBUG os_brick.utils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e66c29-6e52-4abb-a9c9-27c8f706651b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a396877c-38f8-4f42-8234-b84468be7127]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[55662afe-742a-449d-8624-103810688aef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6211d1e-34b9-4233-a4f3-ff387230470e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:02:20 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be40306-bef6-4c3b-bb93-810771a5625f]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG os_brick.utils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating existing volume attachment record: 2f88ab74-efa2-4e37-af1b-3724d2c739b8 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:02:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-01e7008e-750f-45bd-95f1-55a509a06622 req-07d421af-97fa-4157-93ae-fdfc14565ffd service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-01e7008e-750f-45bd-95f1-55a509a06622 req-07d421af-97fa-4157-93ae-fdfc14565ffd service nova] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-01e7008e-750f-45bd-95f1-55a509a06622 req-07d421af-97fa-4157-93ae-fdfc14565ffd service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-01e7008e-750f-45bd-95f1-55a509a06622 req-07d421af-97fa-4157-93ae-fdfc14565ffd service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-01e7008e-750f-45bd-95f1-55a509a06622 req-07d421af-97fa-4157-93ae-fdfc14565ffd service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] No waiting events found dispatching network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:21 user nova-compute[72904]: WARNING nova.compute.manager [req-01e7008e-750f-45bd-95f1-55a509a06622 req-07d421af-97fa-4157-93ae-fdfc14565ffd service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received unexpected event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 for instance with vm_state building and task_state spawning.
Aug 27 05:02:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112543.1529255, 6c6e4a49-6715-4e80-b593-de2b720ae255 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] VM Resumed (Lifecycle Event)
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:02:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Instance spawned successfully.
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:02:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112543.1536274, 6c6e4a49-6715-4e80-b593-de2b720ae255 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] VM Started (Lifecycle Event)
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:23 user nova-compute[72904]: INFO nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:02:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:02:23 user nova-compute[72904]: INFO nova.compute.manager [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Took 6.39 seconds to build instance.
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-04c6cb09-5892-4d1d-bd78-6c514deef9e4 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.526s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-47ee70ac-7dc9-46ae-86ad-9864ccda1a23 req-c3afe8ce-5872-4f6b-8464-0437529e8ee4 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-47ee70ac-7dc9-46ae-86ad-9864ccda1a23 req-c3afe8ce-5872-4f6b-8464-0437529e8ee4 service nova] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-47ee70ac-7dc9-46ae-86ad-9864ccda1a23 req-c3afe8ce-5872-4f6b-8464-0437529e8ee4 service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-47ee70ac-7dc9-46ae-86ad-9864ccda1a23 req-c3afe8ce-5872-4f6b-8464-0437529e8ee4 service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-47ee70ac-7dc9-46ae-86ad-9864ccda1a23 req-c3afe8ce-5872-4f6b-8464-0437529e8ee4 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] No waiting events found dispatching network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:23 user nova-compute[72904]: WARNING nova.compute.manager [req-47ee70ac-7dc9-46ae-86ad-9864ccda1a23 req-c3afe8ce-5872-4f6b-8464-0437529e8ee4 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received unexpected event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 for instance with vm_state active and task_state None.
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lazy-loading 'flavor' on Instance uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:24 user nova-compute[72904]: INFO nova.compute.manager [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Attaching volume b1f7d270-cd66-43e6-8000-a5fed172d681 to /dev/vdb
Aug 27 05:02:24 user nova-compute[72904]: DEBUG os_brick.utils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1e50f0-e893-433c-959f-a817cb102c89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d81aba-b009-4af1-926b-3636d45a304c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98d865-b735-4210-8e7e-d7e6e9d617d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e0d834-1794-466d-9638-905fbff0cffb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:02:24 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbfd63e-45e1-4e9a-8bd8-391c69acd308]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG os_brick.utils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating existing volume attachment record: 26b38d83-91b5-4e21-9fbc-a215e9a8846d {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:02:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-changed-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing instance network info cache due to event network-changed-6b4be91f-fec1-4711-bcd3-1508e3483b83. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] Acquiring lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] Acquired lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Refreshing network info cache for port 6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:02:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:02:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7429MB free_disk=25.788681030273438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance cae1202f-0f6c-437e-8334-215b4736e061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 660b1c77-120e-40d5-b698-b89ec506caf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 72995227-dd52-4b04-a119-41c34dc2e43b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 94a31275-2023-4fc1-a2ca-887a126972e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bd8444b2-1511-446b-8139-3809a4a12e5b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c6e4a49-6715-4e80-b593-de2b720ae255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:02:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:26 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:02:26 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:02:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:02:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.665s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updated VIF entry in instance network info cache for port 6b4be91f-fec1-4711-bcd3-1508e3483b83. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:02:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [{"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ad48d9f-9711-48ac-97c6-8ad30fa54aaf req-65991c9c-58ce-417b-bcaa-7450cc08a6fe service nova] Releasing lock "refresh_cache-94a31275-2023-4fc1-a2ca-887a126972e8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112532.3443704, 93251700-8080-409f-8867-556781572964 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:27 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 93251700-8080-409f-8867-556781572964] VM Stopped (Lifecycle Event)
Aug 27 05:02:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-453ec9ca-0b06-49b1-ad8b-efc4b0222274 None None] [instance: 93251700-8080-409f-8867-556781572964] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "94a31275-2023-4fc1-a2ca-887a126972e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:27 user nova-compute[72904]: INFO nova.compute.manager [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Terminating instance
Aug 27 05:02:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-2fbd8215-7270-47ab-b338-c37912afa059 req-98914071-5ab9-4de1-81f7-77134d2a0775 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2fbd8215-7270-47ab-b338-c37912afa059 req-98914071-5ab9-4de1-81f7-77134d2a0775 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2fbd8215-7270-47ab-b338-c37912afa059 req-98914071-5ab9-4de1-81f7-77134d2a0775 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2fbd8215-7270-47ab-b338-c37912afa059 req-98914071-5ab9-4de1-81f7-77134d2a0775 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-2fbd8215-7270-47ab-b338-c37912afa059 req-98914071-5ab9-4de1-81f7-77134d2a0775 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-unplugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-2fbd8215-7270-47ab-b338-c37912afa059 req-98914071-5ab9-4de1-81f7-77134d2a0775 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f6d0e65-6321-4890-8ba4-ae9b1ebd68dd req-0fe3ce60-4665-483c-adad-649189bab344 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f6d0e65-6321-4890-8ba4-ae9b1ebd68dd req-0fe3ce60-4665-483c-adad-649189bab344 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f6d0e65-6321-4890-8ba4-ae9b1ebd68dd req-0fe3ce60-4665-483c-adad-649189bab344 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2f6d0e65-6321-4890-8ba4-ae9b1ebd68dd req-0fe3ce60-4665-483c-adad-649189bab344 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f6d0e65-6321-4890-8ba4-ae9b1ebd68dd req-0fe3ce60-4665-483c-adad-649189bab344 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-unplugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-2f6d0e65-6321-4890-8ba4-ae9b1ebd68dd req-0fe3ce60-4665-483c-adad-649189bab344 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-d94829ae-2209-414c-970a-d61335d88a33 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-025c3439-03a5-4803-b9e0-ce75618ac444 req-ebed6936-a1e0-4fa7-8858-013f4129a903 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-025c3439-03a5-4803-b9e0-ce75618ac444 req-ebed6936-a1e0-4fa7-8858-013f4129a903 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-025c3439-03a5-4803-b9e0-ce75618ac444 req-ebed6936-a1e0-4fa7-8858-013f4129a903 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-025c3439-03a5-4803-b9e0-ce75618ac444 req-ebed6936-a1e0-4fa7-8858-013f4129a903 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-025c3439-03a5-4803-b9e0-ce75618ac444 req-ebed6936-a1e0-4fa7-8858-013f4129a903 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-unplugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-025c3439-03a5-4803-b9e0-ce75618ac444 req-ebed6936-a1e0-4fa7-8858-013f4129a903 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Instance destroyed successfully.
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lazy-loading 'resources' on Instance uuid 94a31275-2023-4fc1-a2ca-887a126972e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:17:0f,bridge_name='br-int',has_traffic_filtering=True,id=6b4be91f-fec1-4711-bcd3-1508e3483b83,network=Network(e0320489-540b-4a05-8f03-acffe2e60359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4be91f-fe') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:17:0f,bridge_name='br-int',has_traffic_filtering=True,id=6b4be91f-fec1-4711-bcd3-1508e3483b83,network=Network(e0320489-540b-4a05-8f03-acffe2e60359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4be91f-fe') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b4be91f-fe, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: INFO os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:17:0f,bridge_name='br-int',has_traffic_filtering=True,id=6b4be91f-fec1-4711-bcd3-1508e3483b83,network=Network(e0320489-540b-4a05-8f03-acffe2e60359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b4be91f-fe')
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:cb:fa,bridge_name='br-int',has_traffic_filtering=True,id=d94829ae-2209-414c-970a-d61335d88a33,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd94829ae-22') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:cb:fa,bridge_name='br-int',has_traffic_filtering=True,id=d94829ae-2209-414c-970a-d61335d88a33,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd94829ae-22') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd94829ae-22, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: INFO os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:cb:fa,bridge_name='br-int',has_traffic_filtering=True,id=d94829ae-2209-414c-970a-d61335d88a33,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd94829ae-22')
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec18210c-eb48-42cb-9a7a-50e9a429e2ae,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec18210c-eb') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec18210c-eb48-42cb-9a7a-50e9a429e2ae,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec18210c-eb') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec18210c-eb, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: INFO os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c5:b7,bridge_name='br-int',has_traffic_filtering=True,id=ec18210c-eb48-42cb-9a7a-50e9a429e2ae,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapec18210c-eb')
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "7022f918-bdc9-4834-8286-fc31b080657a", "address": "fa:16:3e:62:b4:5f", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.174", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7022f918-bd", "ovs_interfaceid": "7022f918-bdc9-4834-8286-fc31b080657a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:5f,bridge_name='br-int',has_traffic_filtering=True,id=7022f918-bdc9-4834-8286-fc31b080657a,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7022f918-bd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:5f,bridge_name='br-int',has_traffic_filtering=True,id=7022f918-bdc9-4834-8286-fc31b080657a,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7022f918-bd') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7022f918-bd, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: INFO os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:5f,bridge_name='br-int',has_traffic_filtering=True,id=7022f918-bdc9-4834-8286-fc31b080657a,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7022f918-bd')
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:95:9a,bridge_name='br-int',has_traffic_filtering=True,id=08acb973-7a38-4315-aa2f-e9b33b5fed31,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb973-7a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:95:9a,bridge_name='br-int',has_traffic_filtering=True,id=08acb973-7a38-4315-aa2f-e9b33b5fed31,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb973-7a') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08acb973-7a, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: INFO os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:95:9a,bridge_name='br-int',has_traffic_filtering=True,id=08acb973-7a38-4315-aa2f-e9b33b5fed31,network=Network(51cf89c7-8be9-46e4-9e41-4bbeb70b014b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08acb973-7a')
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:19:df,bridge_name='br-int',has_traffic_filtering=True,id=c7e99438-d7fe-4404-b0ad-265fe223e15f,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e99438-d7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:19:df,bridge_name='br-int',has_traffic_filtering=True,id=c7e99438-d7fe-4404-b0ad-265fe223e15f,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e99438-d7') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7e99438-d7, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-6b4be91f-fec1-4711-bcd3-1508e3483b83 for instance with vm_state active and task_state deleting.
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-unplugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-ec18210c-eb48-42cb-9a7a-50e9a429e2ae for instance with vm_state active and task_state deleting.
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-unplugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-7022f918-bdc9-4834-8286-fc31b080657a for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING nova.compute.manager [req-2e089218-9ce5-4057-a9ac-f2aad0f88bb2 req-c45e0200-b330-4883-9350-af1de0665d2e service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-7022f918-bdc9-4834-8286-fc31b080657a for instance with vm_state active and task_state deleting.
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:30 user nova-compute[72904]: INFO os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:19:df,bridge_name='br-int',has_traffic_filtering=True,id=c7e99438-d7fe-4404-b0ad-265fe223e15f,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e99438-d7')
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1582712173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1582712173',id=10,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxkgqVjG/O/BFvVIoUQii6zaa1fdP5mWq1a1J6ruUA3HyytNvdOlYpiKZTsRk+J0U4Oa9AvVhQiEq/z3A0yLtW0O0NpilPkDCKKpbLWqnM3ayjpGjpo1dMDqZdkpmnWPg==',key_name='tempest-keypair-1331608084',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3187574818a94f47aa4961397b84a79a',ramdisk_id='',reservation_id='r-3y28pv1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-37486034',owner_user_name='tempest-TaggedBootDevicesTest-37486034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3eebf8c3b27c49feb6561c7c3af7b1a8',uuid=94a31275-2023-4fc1-a2ca-887a126972e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converting VIF {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=9cd1a40c-3234-440a-afb4-057da3c9bc56,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd1a40c-32') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=9cd1a40c-3234-440a-afb4-057da3c9bc56,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd1a40c-32') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cd1a40c-32, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:30 user nova-compute[72904]: INFO os_vif [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:c5:36,bridge_name='br-int',has_traffic_filtering=True,id=9cd1a40c-3234-440a-afb4-057da3c9bc56,network=Network(740e3689-7e71-432d-ba58-a6ab13925e03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cd1a40c-32')
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZxEswKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae63cecd-1e22-40e5-8c6b-a534d3143483]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4a6332-1132-43b3-9d2c-aec7eeb3ad6e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7df7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c185e0db-f063-4021-ad00-cdad738a32eb]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9855d83b-06cc-46eb-a095-352c6d42649a]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae6a062-bcf4-49f0-99de-9bd128311866]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-d94829ae-2209-414c-970a-d61335d88a33 for instance with vm_state active and task_state deleting.
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-unplugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-c7e99438-d7fe-4404-b0ad-265fe223e15f for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-c7e99438-d7fe-4404-b0ad-265fe223e15f for instance with vm_state active and task_state deleting.
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-unplugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-unplugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING nova.compute.manager [req-563a0c08-a37b-4ad3-99db-77beb523ed4c req-14fee8e5-b2b7-42c4-ae82-177dc0093802 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-9cd1a40c-3234-440a-afb4-057da3c9bc56 for instance with vm_state active and task_state deleting.
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3efd1f5-9c1b-4aba-afe1-dea59cf8f7a8]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1aa736-499e-4685-9100-863109978c6e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[04371729-a324-4aec-b70c-1ca622c23d0e]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260]
Aug 27 05:02:30 user nova-compute[72904]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d76b2786-396b-4b98-bf0b-9233b9d4b3cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c86cdf-418d-43b1-843a-5582653f344f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== disconnect_volume: return (394ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDbOYRdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2572f10f-7567-4690-aa4b-ebe5a87b380e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ecde3f-5eb6-4f7a-89f3-5e65659bbf89]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194cb7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22'): ({'sdc'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Removing single pathed devices sdc {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca9d927-7002-404f-80eb-d94b7ee2b257]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d3031e-d5f0-4043-9593-387aa817b887]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Flushing IO for device /dev/sdc {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-12b9019a-d366-416f-a4cf-2812cf3bda18 req-dd0046d3-486e-4dc9-b5fd-2093eb35b600 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-12b9019a-d366-416f-a4cf-2812cf3bda18 req-dd0046d3-486e-4dc9-b5fd-2093eb35b600 service nova] Acquiring lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-12b9019a-d366-416f-a4cf-2812cf3bda18 req-dd0046d3-486e-4dc9-b5fd-2093eb35b600 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-12b9019a-d366-416f-a4cf-2812cf3bda18 req-dd0046d3-486e-4dc9-b5fd-2093eb35b600 service nova] Lock "94a31275-2023-4fc1-a2ca-887a126972e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-12b9019a-d366-416f-a4cf-2812cf3bda18 req-dd0046d3-486e-4dc9-b5fd-2093eb35b600 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] No waiting events found dispatching network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:30 user nova-compute[72904]: WARNING nova.compute.manager [req-12b9019a-d366-416f-a4cf-2812cf3bda18 req-dd0046d3-486e-4dc9-b5fd-2093eb35b600 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received unexpected event network-vif-plugged-08acb973-7a38-4315-aa2f-e9b33b5fed31 for instance with vm_state active and task_state deleting.
Aug 27 05:02:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[203bf33f-7adb-432b-bb6d-f7fede6d7f77]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c21e42-8a8b-4c5f-9ba7-e0d5069c8ff9]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b559949f-bfa9-4bf2-8cf3-839d5f44a89c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47f476-0e5b-4b39-82e7-7dd40a952d23]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260]
Aug 27 05:02:31 user nova-compute[72904]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5caa498-e3f9-497c-bae9-f2d0e27cbd22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[900c42d8-005d-400c-bcc9-ed9ce1f1e58c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== disconnect_volume: return (315ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFJaGnyN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:31 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95a7811-0ea4-4780-a2e0-7502de566a67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccde8a8-5b91-4f91-a2a9-d46825c6cef8]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:31 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:31 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:31 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb (non-flash)
Aug 27 05:02:31 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:31 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:31 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194cb7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59cd19b-fa8d-498b-8bfb-839f7339a22c]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4372d0d7-5566-44f4-a2ca-277c5b456d68]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a565ee-2ae1-4573-9af2-fe08ae3a0cda]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e20a87-6f35-4c4d-a3eb-54694917b023]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[10949644-148f-428b-b235-45006a87a1ac]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b1e8ec-b310-431b-8c5f-9528d9f19fb2]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260]
Aug 27 05:02:31 user nova-compute[72904]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0449deb8-a7b2-4f6b-a469-a8472837cfeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b67a79-39e7-4fed-8cb3-563d659a6cb7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] <== disconnect_volume: return (338ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Deleting instance files /opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8_del
Aug 27 05:02:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Deletion of /opt/stack/data/nova/instances/94a31275-2023-4fc1-a2ca-887a126972e8_del complete
Aug 27 05:02:31 user nova-compute[72904]: INFO nova.compute.manager [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Took 3.71 seconds to destroy the instance on the hypervisor.
Aug 27 05:02:31 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:02:31 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:02:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-306aec30-1b38-4d1b-8a0c-d1118ee2ed2e req-82b92437-b9eb-4e8e-9ba5-5d77a8e26c90 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-deleted-7022f918-bdc9-4834-8286-fc31b080657a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:33 user nova-compute[72904]: INFO nova.compute.manager [req-306aec30-1b38-4d1b-8a0c-d1118ee2ed2e req-82b92437-b9eb-4e8e-9ba5-5d77a8e26c90 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Neutron deleted interface 7022f918-bdc9-4834-8286-fc31b080657a; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-306aec30-1b38-4d1b-8a0c-d1118ee2ed2e req-82b92437-b9eb-4e8e-9ba5-5d77a8e26c90 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [{"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "address": "fa:16:3e:cf:95:9a", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08acb973-7a", "ovs_interfaceid": "08acb973-7a38-4315-aa2f-e9b33b5fed31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-306aec30-1b38-4d1b-8a0c-d1118ee2ed2e req-82b92437-b9eb-4e8e-9ba5-5d77a8e26c90 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Detach interface failed, port_id=7022f918-bdc9-4834-8286-fc31b080657a, reason: Instance 94a31275-2023-4fc1-a2ca-887a126972e8 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-deleted-08acb973-7a38-4315-aa2f-e9b33b5fed31 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:36 user nova-compute[72904]: INFO nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Neutron deleted interface 08acb973-7a38-4315-aa2f-e9b33b5fed31; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [{"id": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "address": "fa:16:3e:6c:17:0f", "network": {"id": "e0320489-540b-4a05-8f03-acffe2e60359", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1354361128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b4be91f-fe", "ovs_interfaceid": "6b4be91f-fec1-4711-bcd3-1508e3483b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Detach interface failed, port_id=08acb973-7a38-4315-aa2f-e9b33b5fed31, reason: Instance 94a31275-2023-4fc1-a2ca-887a126972e8 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-deleted-6b4be91f-fec1-4711-bcd3-1508e3483b83 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:36 user nova-compute[72904]: INFO nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Neutron deleted interface 6b4be91f-fec1-4711-bcd3-1508e3483b83; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [{"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "address": "fa:16:3e:f9:19:df", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e99438-d7", "ovs_interfaceid": "c7e99438-d7fe-4404-b0ad-265fe223e15f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Detach interface failed, port_id=6b4be91f-fec1-4711-bcd3-1508e3483b83, reason: Instance 94a31275-2023-4fc1-a2ca-887a126972e8 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-deleted-c7e99438-d7fe-4404-b0ad-265fe223e15f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:36 user nova-compute[72904]: INFO nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Neutron deleted interface c7e99438-d7fe-4404-b0ad-265fe223e15f; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [{"id": "d94829ae-2209-414c-970a-d61335d88a33", "address": "fa:16:3e:66:cb:fa", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd94829ae-22", "ovs_interfaceid": "d94829ae-2209-414c-970a-d61335d88a33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "address": "fa:16:3e:74:c5:b7", "network": {"id": "51cf89c7-8be9-46e4-9e41-4bbeb70b014b", "bridge": "br-int", "label": "tempest-device-tagging-net1-856075621", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec18210c-eb", "ovs_interfaceid": "ec18210c-eb48-42cb-9a7a-50e9a429e2ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "address": "fa:16:3e:b8:c5:36", "network": {"id": "740e3689-7e71-432d-ba58-a6ab13925e03", "bridge": "br-int", "label": "tempest-device-tagging-net2-342317050", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3187574818a94f47aa4961397b84a79a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cd1a40c-32", "ovs_interfaceid": "9cd1a40c-3234-440a-afb4-057da3c9bc56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-832a5a77-bf7f-44a7-af67-1d486ea78de0 req-577d16f4-87f1-4c83-85ec-b1cfd3d32117 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Detach interface failed, port_id=c7e99438-d7fe-4404-b0ad-265fe223e15f, reason: Instance 94a31275-2023-4fc1-a2ca-887a126972e8 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:36 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Took 4.67 seconds to deallocate network for instance.
Aug 27 05:02:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGyslYBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:36 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:36 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:36 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6888638-f6a2-4c52-9f8d-8a61adf8d9ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:02:36 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0ea2c5-61dc-42c1-8ba4-484cb661363e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672] added
Aug 27 05:02:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7717be21-ca9d-4759-aa79-480609934013]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775604c-c302-424f-ba12-5ffa34f86bec]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGyslYBb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGyslYBb" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a31d8c-b930-49ba-a0b2-6c92f98c9501]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGyslYBb'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[25097e1f-284b-46ae-82cd-34718e894702]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2607c054-c8cf-4a45-960e-f5f123ffed50]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:36 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:36 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:36 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:36 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --login" returned: 0 in 1.070s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ae7921-5252-478b-8fd2-7b78417c1118]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260]
Aug 27 05:02:37 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:37 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af95858-069c-48b2-89f0-8af38228323b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c39b4cd-8e8b-44d8-9021-33648d4494f0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.321s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7f7b06-fb65-4bf4-9b80-4936295360cb]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-d9ad0604-e58c-4ff9-bcc2-598b677c2036 req-7397a823-2d5f-4aa2-9fbf-541003417659 service nova] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Received event network-vif-deleted-9cd1a40c-3234-440a-afb4-057da3c9bc56 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:38 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:38 user nova-compute[72904]: INFO nova.compute.manager [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Took 2.75 seconds to detach 3 volumes for instance.
Aug 27 05:02:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGyslYBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.358s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] <== connect_volume: return (2360ms) {'type': 'block', 'scsi_wwn': '23061336533376566', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061336533376566', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.392s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:39 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:39 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.objects.instance [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'flavor' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d14ac5-ce59-4d76-b212-681d183f3e77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:02:39 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:02:39 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:02:39 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:02:39 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:02:39 user nova-compute[72904]:   <serial>4003285f-2c5d-4cda-82f6-d0e46fdc8672</serial>
Aug 27 05:02:39 user nova-compute[72904]: </disk>
Aug 27 05:02:39 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d341d64-6ec1-4593-a77f-28764061b586]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681] added
Aug 27 05:02:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e45c7f-6cd3-438d-9827-f012354a24be]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f3021-bbd9-4e65-9261-2219b66f9eb5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQYhIgd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQYhIgd" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddde88cb-aac8-40ab-9110-49062e34d132]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZwQYhIgd'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120d2d2-06f6-4b2b-94bb-f6f6ebc2dd91]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b46ad2-2fba-44a7-b29f-e28c1c8f074a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24e8138-f3a1-4157-a28a-e505139661c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]
Aug 27 05:02:39 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c6841-e5b5-4900-a817-14bcdfaf27f9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Deleted allocations for instance 94a31275-2023-4fc1-a2ca-887a126972e8
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76ab95b-af4b-43d2-81c4-b051f3f26c3b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5e1091-596a-444d-b69a-c36972d1fc22]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f29b93c5-5b10-400f-8864-a422619137e9 tempest-TaggedBootDevicesTest-37486034 tempest-TaggedBootDevicesTest-37486034-project-member] Lock "94a31275-2023-4fc1-a2ca-887a126972e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.728s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No VIF found with MAC fa:16:3e:ff:37:d6, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:02:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-98d7b01f-f6f6-4b88-bdcf-fe8c8af22344 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.713s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== connect_volume: return (1755ms) {'type': 'block', 'scsi_wwn': '26138366665646438', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138366665646438', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lazy-loading 'flavor' on Instance uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:02:40 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:02:40 user nova-compute[72904]:   <source dev="/dev/sdc"/>
Aug 27 05:02:40 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:02:40 user nova-compute[72904]:   <serial>b1f7d270-cd66-43e6-8000-a5fed172d681</serial>
Aug 27 05:02:40 user nova-compute[72904]: </disk>
Aug 27 05:02:40 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:02:40 user nova-compute[72904]: INFO nova.compute.manager [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Rescuing
Aug 27 05:02:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No VIF found with MAC fa:16:3e:67:1b:45, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:41 user nova-compute[72904]: INFO nova.compute.manager [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Terminating instance
Aug 27 05:02:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cf1f36ed-73d7-4c90-b50a-d6ebd6ac082e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.945s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-660d53a5-7975-4d9a-9344-e7148b6e9561 req-9067fdee-62d0-44ad-9ab7-959373594411 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-unplugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-660d53a5-7975-4d9a-9344-e7148b6e9561 req-9067fdee-62d0-44ad-9ab7-959373594411 service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-660d53a5-7975-4d9a-9344-e7148b6e9561 req-9067fdee-62d0-44ad-9ab7-959373594411 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-660d53a5-7975-4d9a-9344-e7148b6e9561 req-9067fdee-62d0-44ad-9ab7-959373594411 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-660d53a5-7975-4d9a-9344-e7148b6e9561 req-9067fdee-62d0-44ad-9ab7-959373594411 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-unplugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-660d53a5-7975-4d9a-9344-e7148b6e9561 req-9067fdee-62d0-44ad-9ab7-959373594411 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-unplugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-4cc00d62-0e21-4c10-b3d9-15c91916a600 req-6e25a457-91ca-4bba-b5a3-e51ea0ec882d service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4cc00d62-0e21-4c10-b3d9-15c91916a600 req-6e25a457-91ca-4bba-b5a3-e51ea0ec882d service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4cc00d62-0e21-4c10-b3d9-15c91916a600 req-6e25a457-91ca-4bba-b5a3-e51ea0ec882d service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4cc00d62-0e21-4c10-b3d9-15c91916a600 req-6e25a457-91ca-4bba-b5a3-e51ea0ec882d service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-4cc00d62-0e21-4c10-b3d9-15c91916a600 req-6e25a457-91ca-4bba-b5a3-e51ea0ec882d service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:41 user nova-compute[72904]: WARNING nova.compute.manager [req-4cc00d62-0e21-4c10-b3d9-15c91916a600 req-6e25a457-91ca-4bba-b5a3-e51ea0ec882d service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state active and task_state rescuing.
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Instance destroyed successfully.
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lazy-loading 'resources' on Instance uuid e165c9ab-f2e0-43b4-bdcd-d92abd46c424 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance destroyed successfully.
Aug 27 05:02:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Attempting a stable device rescue
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T04:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1342835485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1342835485',id=7,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAciaZPZaCJGxXOOKlsbJ//xWfo4ksogNHfXMFLKueAWuieNVHgrMq6LO1M4N0Uyjna8u9qjgK5y9el1SbwjNLuHaSB/p3SpBWGFdOSomnz5j6eWVQ97zEHQWWQdnd6WfA==',key_name='tempest-keypair-109214732',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee8b8fa582214642ba95f4e685a954c8',ramdisk_id='',reservation_id='r-0e137ibn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-67395385',owner_user_name='tempest-TaggedAttachmentsTest-67395385-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aad703280f584c9da9c6aeb37d328dc2',uuid=e165c9ab-f2e0-43b4-bdcd-d92abd46c424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converting VIF {"id": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "address": "fa:16:3e:5c:fc:49", "network": {"id": "604b446c-c3e7-4a25-9278-1ac6156294b9", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1112568604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee8b8fa582214642ba95f4e685a954c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c8e17d-17", "ovs_interfaceid": "64c8e17d-17d8-49b8-8264-b8b56c9c27c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:fc:49,bridge_name='br-int',has_traffic_filtering=True,id=64c8e17d-17d8-49b8-8264-b8b56c9c27c0,network=Network(604b446c-c3e7-4a25-9278-1ac6156294b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c8e17d-17') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG os_vif [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:fc:49,bridge_name='br-int',has_traffic_filtering=True,id=64c8e17d-17d8-49b8-8264-b8b56c9c27c0,network=Network(604b446c-c3e7-4a25-9278-1ac6156294b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c8e17d-17') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c8e17d-17, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:42 user nova-compute[72904]: INFO os_vif [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:fc:49,bridge_name='br-int',has_traffic_filtering=True,id=64c8e17d-17d8-49b8-8264-b8b56c9c27c0,network=Network(604b446c-c3e7-4a25-9278-1ac6156294b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c8e17d-17')
Aug 27 05:02:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Deleting instance files /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424_del
Aug 27 05:02:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Deletion of /opt/stack/data/nova/instances/e165c9ab-f2e0-43b4-bdcd-d92abd46c424_del complete
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72904) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:02:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Creating image(s)
Aug 27 05:02:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'trusted_certs' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "503908f04c91f9ec74bcbddf223270270ce2ae11" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "503908f04c91f9ec74bcbddf223270270ce2ae11" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:42 user nova-compute[72904]: INFO nova.compute.manager [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 27 05:02:42 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:02:42 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a5d805b7-c6f5-4f8a-b087-7e75d344a3c5 req-b2bac723-d85a-4a49-ad1e-262d2f58cd72 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a5d805b7-c6f5-4f8a-b087-7e75d344a3c5 req-b2bac723-d85a-4a49-ad1e-262d2f58cd72 service nova] Acquiring lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a5d805b7-c6f5-4f8a-b087-7e75d344a3c5 req-b2bac723-d85a-4a49-ad1e-262d2f58cd72 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a5d805b7-c6f5-4f8a-b087-7e75d344a3c5 req-b2bac723-d85a-4a49-ad1e-262d2f58cd72 service nova] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a5d805b7-c6f5-4f8a-b087-7e75d344a3c5 req-b2bac723-d85a-4a49-ad1e-262d2f58cd72 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] No waiting events found dispatching network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:43 user nova-compute[72904]: WARNING nova.compute.manager [req-a5d805b7-c6f5-4f8a-b087-7e75d344a3c5 req-b2bac723-d85a-4a49-ad1e-262d2f58cd72 service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received unexpected event network-vif-plugged-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 for instance with vm_state active and task_state deleting.
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Stashing vm_state: active {{(pid=72904) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.part --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.virt.images [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] 4e50f241-1ebc-422d-9f24-e5b55eb4ada0 was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.part /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:43 user nova-compute[72904]: WARNING nova.compute.manager [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state active and task_state rescuing.
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-changed-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing instance network info cache due to event network-changed-04b5cb8f-d374-4b57-a4d6-59a6338f88ae. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] Acquiring lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] Acquired lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Refreshing network info cache for port 04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:02:43 user nova-compute[72904]: INFO nova.compute.claims [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Claim successful on node user
Aug 27 05:02:43 user nova-compute[72904]: INFO nova.compute.resource_tracker [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating resource usage from migration ed9e1e09-f8cf-4775-816c-a283848607bb
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.part /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.converted" returned: 0 in 0.409s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "503908f04c91f9ec74bcbddf223270270ce2ae11" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.997s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "503908f04c91f9ec74bcbddf223270270ce2ae11" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "503908f04c91f9ec74bcbddf223270270ce2ae11" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.626s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:44 user nova-compute[72904]: INFO nova.compute.manager [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Migrating
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:44 user nova-compute[72904]: INFO nova.compute.rpcapi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11 --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11,backing_fmt=raw /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11,backing_fmt=raw /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue" returned: 0 in 0.057s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "503908f04c91f9ec74bcbddf223270270ce2ae11" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'migration_context' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Object Instance<cae1202f-0f6c-437e-8334-215b4736e061> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Start _get_guest_xml network_info=[{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "vif_mac": "fa:16:3e:ff:37:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4e50f241-1ebc-422d-9f24-e5b55eb4ada0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2f88ab74-efa2-4e37-af1b-3724d2c739b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGyslYBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'cae1202f-0f6c-437e-8334-215b4736e061', 'attached_at': '', 'detached_at': '', 'volume_id': '4003285f-2c5d-4cda-82f6-d0e46fdc8672', 'serial': '4003285f-2c5d-4cda-82f6-d0e46fdc8672'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'resources' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Object Instance<cae1202f-0f6c-437e-8334-215b4736e061> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'numa_topology' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Object Instance<cae1202f-0f6c-437e-8334-215b4736e061> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:02:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:02:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'vcpu_model' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.objects.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Object Instance<cae1202f-0f6c-437e-8334-215b4736e061> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGyslYBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:44 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:44 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:44 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112549.7623699, 94a31275-2023-4fc1-a2ca-887a126972e8 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:44 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] VM Stopped (Lifecycle Event)
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ecec036c-bbf6-4446-a034-b15969eaeffe None None] [instance: 94a31275-2023-4fc1-a2ca-887a126972e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5838adf-7926-4218-9ad5-6f4045ff7ee2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JGyslYBb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 05:02:44 user nova-compute[72904]: node.name = iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672
Aug 27 05:02:44 user nova-compute[72904]: node.tpgt = -1
Aug 27 05:02:44 user nova-compute[72904]: node.startup = automatic
Aug 27 05:02:44 user nova-compute[72904]: node.leading_login = No
Aug 27 05:02:44 user nova-compute[72904]: iface.iscsi_ifacename = default
Aug 27 05:02:44 user nova-compute[72904]: iface.net_ifacename = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.ipaddress = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.prefix_len = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.hwaddress = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.transport_name = tcp
Aug 27 05:02:44 user nova-compute[72904]: iface.initiatorname = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.state = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.vlan_id = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.vlan_priority = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.vlan_state = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.iface_num = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.mtu = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.port = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.bootproto = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.subnet_mask = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.gateway = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_alt_client_id = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_dns = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_learn_iqn = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_vendor_id_state = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_vendor_id = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.dhcp_slp_da = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.fragmentation = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.gratuitous_arp = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.incoming_forwarding = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.tos_state = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.tos = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.ttl = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.delayed_ack = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.tcp_nagle = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.tcp_wsf_state = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.tcp_wsf = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.tcp_timer_scale = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.tcp_timestamp = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.redirect = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.def_task_mgmt_timeout = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.header_digest = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.data_digest = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.immediate_data = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.initial_r2t = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.data_seq_inorder = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.data_pdu_inorder = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.erl = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.max_receive_data_len = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.first_burst_len = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.max_outstanding_r2t = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.max_burst_len = 0
Aug 27 05:02:44 user nova-compute[72904]: iface.chap_auth = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.bidi_chap = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.strict_login_compliance = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.discovery_auth = <empty>
Aug 27 05:02:44 user nova-compute[72904]: iface.discovery_logout = <empty>
Aug 27 05:02:44 user nova-compute[72904]: node.discovery_address = <empty>
Aug 27 05:02:44 user nova-compute[72904]: node.discovery_port = 0
Aug 27 05:02:44 user nova-compute[72904]: node.discovery_type = static
Aug 27 05:02:44 user nova-compute[72904]: node.session.initial_cmdsn = 0
Aug 27 05:02:44 user nova-compute[72904]: node.session.initial_login_retry_max = 8
Aug 27 05:02:44 user nova-compute[72904]: node.session.xmit_thread_priority = -20
Aug 27 05:02:44 user nova-compute[72904]: node.session.cmds_max = 128
Aug 27 05:02:44 user nova-compute[72904]: node.session.queue_depth = 32
Aug 27 05:02:44 user nova-compute[72904]: node.session.nr_sessions = 1
Aug 27 05:02:44 user nova-compute[72904]: node.session.auth.authmethod = CHAP
Aug 27 05:02:44 user nova-compute[72904]: node.session.auth.username = JGyslYBb
Aug 27 05:02:44 user nova-compute[72904]: node.session.auth.password = ***
Aug 27 05:02:44 user nova-compute[72904]: node.session.auth.username_in = <empty>
Aug 27 05:02:44 user nova-compute[72904]: node.session.auth.password_in = <empty>
Aug 27 05:02:44 user nova-compute[72904]: node.session.auth.chap_algs = MD5
Aug 27 05:02:44 user nova-compute[72904]: node.session.timeo.replacement_timeout = 120
Aug 27 05:02:44 user nova-compute[72904]: node.session.err_timeo.abort_timeout = 15
Aug 27 05:02:44 user nova-compute[72904]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 05:02:44 user nova-compute[72904]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 05:02:44 user nova-compute[72904]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.FastAbort = Yes
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.InitialR2T = No
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.ImmediateData = Yes
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.MaxConnections = 1
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 05:02:44 user nova-compute[72904]: node.session.iscsi.ERL = 0
Aug 27 05:02:44 user nova-compute[72904]: node.session.scan = manual
Aug 27 05:02:44 user nova-compute[72904]: node.session.reopen_max = 0
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].address = 172.16.0.220
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].port = 3260
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].startup = manual
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].tcp.window_size = 524288
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].tcp.type_of_service = 0
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].timeo.logout_timeout = 15
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].timeo.login_timeout = 15
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].timeo.auth_timeout = 45
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].iscsi.DataDigest = None
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].iscsi.IFMarker = No
Aug 27 05:02:44 user nova-compute[72904]: node.conn[0].iscsi.OFMarker = No
Aug 27 05:02:44 user nova-compute[72904]: # END RECORD
Aug 27 05:02:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.088s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb64da-aef9-4ec3-ab94-d3af86273391]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fdb5f6-4e77-4c64-9314-9d5b465b2d5b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGyslYBb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGyslYBb" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75c852b-717a-415e-862d-6daa3e59a3cd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGyslYBb'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066d88e-9954-4374-98b6-8f1920a57f72]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5192e9-805e-4e97-a21c-39f744c12e75]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] HCTL ('33', '0', '0', 0) found on session 16 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a5de7-5e8c-4a82-b0b1-24d0929683c8]: (4, ('0 0 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Searching for a device in session 16 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGyslYBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.260s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] <== connect_volume: return (261ms) {'type': 'block', 'scsi_wwn': '23061336533376566', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061336533376566', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1516546030',display_name='tempest-ServerStableDeviceRescueTest-server-1516546030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1516546030',id=3,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXPJ3ICrlA/cmQIas/XcCpHwfVtvqbwe/pMXrS60OLOmiDcBvKM4sTK5i5N1RlrmPCuHF7isVXR3d9y/cD+PEQxszneeTg/yBdt9s6dYyPTX8VIAzpg+mXwOatTCMOmww==',key_name='tempest-keypair-509925292',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:58:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26df968c46154c42bd5889d09318bbe2',ramdisk_id='',reservation_id='r-7xre0f4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-117364697',owner_user_name='tempest-ServerStableDeviceRescueTest-117364697-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f916716b9147f28b371d499b31aff8',uuid=cae1202f-0f6c-437e-8334-215b4736e061,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "vif_mac": "fa:16:3e:ff:37:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converting VIF {"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "vif_mac": "fa:16:3e:ff:37:d6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'pci_devices' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.objects.base [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Object Instance<cae1202f-0f6c-437e-8334-215b4736e061> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:02:45 user nova-compute[72904]:   <uuid>cae1202f-0f6c-437e-8334-215b4736e061</uuid>
Aug 27 05:02:45 user nova-compute[72904]:   <name>instance-00000003</name>
Aug 27 05:02:45 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:02:45 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:02:45 user nova-compute[72904]:   <metadata>
Aug 27 05:02:45 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:02:45 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:02:45 user nova-compute[72904]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1516546030</nova:name>
Aug 27 05:02:45 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:02:44</nova:creationTime>
Aug 27 05:02:45 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:02:45 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:02:45 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:02:45 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:02:45 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:02:45 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:02:45 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:02:45 user nova-compute[72904]:       <nova:owner>
Aug 27 05:02:45 user nova-compute[72904]:         <nova:user uuid="99f916716b9147f28b371d499b31aff8">tempest-ServerStableDeviceRescueTest-117364697-project-member</nova:user>
Aug 27 05:02:45 user nova-compute[72904]:         <nova:project uuid="26df968c46154c42bd5889d09318bbe2">tempest-ServerStableDeviceRescueTest-117364697</nova:project>
Aug 27 05:02:45 user nova-compute[72904]:       </nova:owner>
Aug 27 05:02:45 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:02:45 user nova-compute[72904]:       <nova:ports>
Aug 27 05:02:45 user nova-compute[72904]:         <nova:port uuid="25f639bd-e92f-45c8-be05-fe92c4ee4e39">
Aug 27 05:02:45 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 05:02:45 user nova-compute[72904]:         </nova:port>
Aug 27 05:02:45 user nova-compute[72904]:       </nova:ports>
Aug 27 05:02:45 user nova-compute[72904]:     </nova:instance>
Aug 27 05:02:45 user nova-compute[72904]:   </metadata>
Aug 27 05:02:45 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:02:45 user nova-compute[72904]:     <system>
Aug 27 05:02:45 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:02:45 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:02:45 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:02:45 user nova-compute[72904]:       <entry name="serial">cae1202f-0f6c-437e-8334-215b4736e061</entry>
Aug 27 05:02:45 user nova-compute[72904]:       <entry name="uuid">cae1202f-0f6c-437e-8334-215b4736e061</entry>
Aug 27 05:02:45 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:02:45 user nova-compute[72904]:     </system>
Aug 27 05:02:45 user nova-compute[72904]:   </sysinfo>
Aug 27 05:02:45 user nova-compute[72904]:   <os>
Aug 27 05:02:45 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:02:45 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:02:45 user nova-compute[72904]:   </os>
Aug 27 05:02:45 user nova-compute[72904]:   <features>
Aug 27 05:02:45 user nova-compute[72904]:     <acpi/>
Aug 27 05:02:45 user nova-compute[72904]:     <apic/>
Aug 27 05:02:45 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:02:45 user nova-compute[72904]:   </features>
Aug 27 05:02:45 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:02:45 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:02:45 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:02:45 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:02:45 user nova-compute[72904]:   </clock>
Aug 27 05:02:45 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:02:45 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:02:45 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:02:45 user nova-compute[72904]:   </cpu>
Aug 27 05:02:45 user nova-compute[72904]:   <devices>
Aug 27 05:02:45 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:02:45 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:02:45 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk"/>
Aug 27 05:02:45 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:02:45 user nova-compute[72904]:     </disk>
Aug 27 05:02:45 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:02:45 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:02:45 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:02:45 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:02:45 user nova-compute[72904]:       <serial>4003285f-2c5d-4cda-82f6-d0e46fdc8672</serial>
Aug 27 05:02:45 user nova-compute[72904]:     </disk>
Aug 27 05:02:45 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:02:45 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:02:45 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue"/>
Aug 27 05:02:45 user nova-compute[72904]:       <target dev="vdc" bus="virtio"/>
Aug 27 05:02:45 user nova-compute[72904]:       <boot order="1"/>
Aug 27 05:02:45 user nova-compute[72904]:     </disk>
Aug 27 05:02:45 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:02:45 user nova-compute[72904]:       <mac address="fa:16:3e:ff:37:d6"/>
Aug 27 05:02:45 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:02:45 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:02:45 user nova-compute[72904]:       <target dev="tap25f639bd-e9"/>
Aug 27 05:02:45 user nova-compute[72904]:     </interface>
Aug 27 05:02:45 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:02:45 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/console.log" append="off"/>
Aug 27 05:02:45 user nova-compute[72904]:     </serial>
Aug 27 05:02:45 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:02:45 user nova-compute[72904]:     <video>
Aug 27 05:02:45 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:02:45 user nova-compute[72904]:     </video>
Aug 27 05:02:45 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:02:45 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:02:45 user nova-compute[72904]:     </rng>
Aug 27 05:02:45 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:02:45 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:02:45 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:02:45 user nova-compute[72904]:     </memballoon>
Aug 27 05:02:45 user nova-compute[72904]:   </devices>
Aug 27 05:02:45 user nova-compute[72904]: </domain>
Aug 27 05:02:45 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:02:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance destroyed successfully.
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.network.neutron [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updated VIF entry in instance network info cache for port 04b5cb8f-d374-4b57-a4d6-59a6338f88ae. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.network.neutron [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] No VIF found with MAC fa:16:3e:ff:37:d6, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8466a866-197b-4d63-9733-0133a769b0bd req-704ae8f2-41b0-4ef6-9028-5a8dc9a5de70 service nova] Releasing lock "refresh_cache-bd8444b2-1511-446b-8139-3809a4a12e5b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:45 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Took 2.71 seconds to deallocate network for instance.
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Starting migrate_disk_and_power_off {{(pid=72904) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:45 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Deleted allocations for instance e165c9ab-f2e0-43b4-bdcd-d92abd46c424
Aug 27 05:02:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-ff68e592-bede-43dd-8c0a-8b55f6e04c1c req-1d99238e-1c44-4711-8e8f-b6f5b03d26ec service nova] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Received event network-vif-deleted-64c8e17d-17d8-49b8-8264-b8b56c9c27c0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b79ab6e7-00b5-4729-8294-2fb841634161 tempest-TaggedAttachmentsTest-67395385 tempest-TaggedAttachmentsTest-67395385-project-member] Lock "e165c9ab-f2e0-43b4-bdcd-d92abd46c424" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.892s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-13b0127c-7df3-494b-9561-d2ad401ce0cf req-70b53948-1e04-4dc8-b811-a42418ad121c service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-13b0127c-7df3-494b-9561-d2ad401ce0cf req-70b53948-1e04-4dc8-b811-a42418ad121c service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-13b0127c-7df3-494b-9561-d2ad401ce0cf req-70b53948-1e04-4dc8-b811-a42418ad121c service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-13b0127c-7df3-494b-9561-d2ad401ce0cf req-70b53948-1e04-4dc8-b811-a42418ad121c service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-13b0127c-7df3-494b-9561-d2ad401ce0cf req-70b53948-1e04-4dc8-b811-a42418ad121c service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:46 user nova-compute[72904]: WARNING nova.compute.manager [req-13b0127c-7df3-494b-9561-d2ad401ce0cf req-70b53948-1e04-4dc8-b811-a42418ad121c service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_migrating.
Aug 27 05:02:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:46 user nova-compute[72904]: INFO nova.compute.manager [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Terminating instance
Aug 27 05:02:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance destroyed successfully.
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:58:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:02:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2120101558-network", "vif_mac": "fa:16:3e:67:1b:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2120101558-network", "vif_mac": "fa:16:3e:67:1b:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_vif [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4285663-09, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: INFO os_vif [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09')
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:47 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[92718254-15d1-4648-83af-94939d59ce5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0454d7-2892-4604-911c-1b076b0fbdcd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7df370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'): ({'sdc'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Removing single pathed devices sdc {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c6986f-36ca-4307-9858-4134b73ca0a7]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[810d7032-d6d7-44ff-b1d1-adcdc5c20e97]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flushing IO for device /dev/sdc {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a91f221-4bff-4621-a8ee-c540c06dda8e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[110f463c-b5c7-4406-8027-475521c8661e]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196d659-1079-4f5a-95ec-d572eeae109e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c1a87-d6ff-4fe0-83e3-26660d45376d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]
Aug 27 05:02:47 user nova-compute[72904]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a00d4-eb08-4afd-bee0-631022f9a369]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== disconnect_volume: return (416ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-515fba05-f0af-498b-95f2-0fc5938fcfc3 req-a15a79cb-eaf2-4df7-a76d-8a6e3f88e637 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-515fba05-f0af-498b-95f2-0fc5938fcfc3 req-a15a79cb-eaf2-4df7-a76d-8a6e3f88e637 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-515fba05-f0af-498b-95f2-0fc5938fcfc3 req-a15a79cb-eaf2-4df7-a76d-8a6e3f88e637 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-515fba05-f0af-498b-95f2-0fc5938fcfc3 req-a15a79cb-eaf2-4df7-a76d-8a6e3f88e637 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-515fba05-f0af-498b-95f2-0fc5938fcfc3 req-a15a79cb-eaf2-4df7-a76d-8a6e3f88e637 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-unplugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-515fba05-f0af-498b-95f2-0fc5938fcfc3 req-a15a79cb-eaf2-4df7-a76d-8a6e3f88e637 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-3ac993c6-0086-45ca-88a7-2d7905d0e626 req-55e00d8d-edb0-4fd3-9fed-307a7ed4ec10 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3ac993c6-0086-45ca-88a7-2d7905d0e626 req-55e00d8d-edb0-4fd3-9fed-307a7ed4ec10 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3ac993c6-0086-45ca-88a7-2d7905d0e626 req-55e00d8d-edb0-4fd3-9fed-307a7ed4ec10 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3ac993c6-0086-45ca-88a7-2d7905d0e626 req-55e00d8d-edb0-4fd3-9fed-307a7ed4ec10 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-3ac993c6-0086-45ca-88a7-2d7905d0e626 req-55e00d8d-edb0-4fd3-9fed-307a7ed4ec10 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-unplugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-3ac993c6-0086-45ca-88a7-2d7905d0e626 req-55e00d8d-edb0-4fd3-9fed-307a7ed4ec10 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-2b6e6460-b500-4589-af0b-6927510c9e49 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:48 user nova-compute[72904]: WARNING nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_migrating.
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:48 user nova-compute[72904]: WARNING nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_migrating.
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:48 user nova-compute[72904]: WARNING nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_migrating.
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:48 user nova-compute[72904]: WARNING nova.compute.manager [req-790b8b25-9a86-4f9f-aa6e-e783a66c64a8 req-46950a65-7f70-4432-84a2-254a632245d2 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_migrating.
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0_resize/disk /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "cp -r /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0_resize/disk /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk" returned: 0 in 0.594s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0_resize/disk.info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk.info {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "cp -r /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0_resize/disk.info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk.info" returned: 0 in 0.070s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Instance destroyed successfully.
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.objects.instance [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lazy-loading 'resources' on Instance uuid bd8444b2-1511-446b-8139-3809a4a12e5b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:01:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:3f:23,bridge_name='br-int',has_traffic_filtering=True,id=04b5cb8f-d374-4b57-a4d6-59a6338f88ae,network=Network(01db7bb6-6663-4f56-a0e1-1982c4584e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5cb8f-d3') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:3f:23,bridge_name='br-int',has_traffic_filtering=True,id=04b5cb8f-d374-4b57-a4d6-59a6338f88ae,network=Network(01db7bb6-6663-4f56-a0e1-1982c4584e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5cb8f-d3') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04b5cb8f-d3, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: INFO os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:3f:23,bridge_name='br-int',has_traffic_filtering=True,id=04b5cb8f-d374-4b57-a4d6-59a6338f88ae,network=Network(01db7bb6-6663-4f56-a0e1-1982c4584e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b5cb8f-d3')
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:01:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:78:2a,bridge_name='br-int',has_traffic_filtering=True,id=44588416-88f1-44a9-913d-0b4270e4c2c1,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44588416-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:78:2a,bridge_name='br-int',has_traffic_filtering=True,id=44588416-88f1-44a9-913d-0b4270e4c2c1,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44588416-88') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44588416-88, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: INFO os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:78:2a,bridge_name='br-int',has_traffic_filtering=True,id=44588416-88f1-44a9-913d-0b4270e4c2c1,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44588416-88')
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:01:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=decd4865-3f96-4ebc-8c49-2e6e3342c870,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecd4865-3f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=decd4865-3f96-4ebc-8c49-2e6e3342c870,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecd4865-3f') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdecd4865-3f, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: INFO os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:76:0b,bridge_name='br-int',has_traffic_filtering=True,id=decd4865-3f96-4ebc-8c49-2e6e3342c870,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdecd4865-3f')
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:01:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:91:43,bridge_name='br-int',has_traffic_filtering=True,id=2ef82d54-e731-4761-82fa-49fcc3a33dc0,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef82d54-e7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:91:43,bridge_name='br-int',has_traffic_filtering=True,id=2ef82d54-e731-4761-82fa-49fcc3a33dc0,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef82d54-e7') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ef82d54-e7, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: INFO os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:91:43,bridge_name='br-int',has_traffic_filtering=True,id=2ef82d54-e731-4761-82fa-49fcc3a33dc0,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ef82d54-e7')
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:01:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b6e6460-b500-4589-af0b-6927510c9e49,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e6460-b5') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b6e6460-b500-4589-af0b-6927510c9e49,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e6460-b5') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b6e6460-b5, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: INFO os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:87:a1,bridge_name='br-int',has_traffic_filtering=True,id=2b6e6460-b500-4589-af0b-6927510c9e49,network=Network(fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b6e6460-b5')
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:01:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8d8efd4c-6aad-4bdf-b865-080a929bb813,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8efd4c-6a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8d8efd4c-6aad-4bdf-b865-080a929bb813,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8efd4c-6a') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d8efd4c-6a, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: INFO os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:12:e9,bridge_name='br-int',has_traffic_filtering=True,id=8d8efd4c-6aad-4bdf-b865-080a929bb813,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8efd4c-6a')
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-27T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1603366599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1603366599',id=11,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6DHpW6JVhLUREWVvKQMUWgfgxqQ5vm4Nz2EUoyGZW5UBY255KyCkNW78qGv+/zYn/tjpMxgy8ARZ+glY7w9Ehy1/dStzqStoRELm8nrpvlQszsWQUGab6lmObfRpSZdw==',key_name='tempest-keypair-240682303',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:01:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a6ee805ec6241d0a7159d2add36aa10',ramdisk_id='',reservation_id='r-owzj6kn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-96474791',owner_user_name='tempest-TaggedBootDevicesTest_v242-96474791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d346fd49936b48d4a55681a18b70f0f6',uuid=bd8444b2-1511-446b-8139-3809a4a12e5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converting VIF {"id": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "address": "fa:16:3e:66:6d:ad", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20686a0f-ec", "ovs_interfaceid": "20686a0f-ec45-4c05-aae9-872242a5cd3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=20686a0f-ec45-4c05-aae9-872242a5cd3e,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20686a0f-ec') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=20686a0f-ec45-4c05-aae9-872242a5cd3e,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20686a0f-ec') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20686a0f-ec, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:49 user nova-compute[72904]: INFO os_vif [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:6d:ad,bridge_name='br-int',has_traffic_filtering=True,id=20686a0f-ec45-4c05-aae9-872242a5cd3e,network=Network(e7acb99f-fd8f-4013-b891-d69675ef0722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20686a0f-ec')
Aug 27 05:02:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pwyMKCDJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:49 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67700c1-8842-4902-8c00-7de8930aa41a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[64503f10-dc8a-4048-8593-38faf4b6183b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7d68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3'): ({'sde'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Removing single pathed devices sde {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a64176f-0d82-4146-b955-a2d6c1eac27e]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38bc153-4e65-42da-b9e1-36a4d0ca42ab]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Flushing IO for device /dev/sde {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fda8b17-48e7-436a-874c-21376bcb94a7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb2d9ca-0791-4875-9f34-97496f8e070b]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[573563cf-b0a8-43a8-bc7d-72674c5e3661]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-2b6e6460-b500-4589-af0b-6927510c9e49 for instance with vm_state active and task_state deleting.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-unplugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-55d6ea39-95ca-45cf-bd68-cf024c63c7c6 req-7fc2239c-a857-4061-a0bf-9cae9a52ff9f service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-8d8efd4c-6aad-4bdf-b865-080a929bb813 for instance with vm_state active and task_state deleting.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.266s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[844a30c7-885c-4a9a-b0ad-87fcbdf761f4]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260]
Aug 27 05:02:50 user nova-compute[72904]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-04b5cb8f-d374-4b57-a4d6-59a6338f88ae for instance with vm_state active and task_state deleting.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state active and task_state rescuing.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state active and task_state rescuing.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-unplugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-6874c738-91ef-434e-a058-2e3826d67efc req-4c501a9a-ffe2-440f-92f5-2ae655240ee9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ef12307-c3bf-40cc-a2a8-75a0e0fa03a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.121s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d762fe-2e38-4b2f-ab01-9e907e2f373c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.636s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== disconnect_volume: return (638ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'okDwyQmX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3d5564-e00a-44c0-8a52-135c715d65dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b377c6-a757-45b8-b26b-b7cac5bb291f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f918c133400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755'): ({'sdf'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Removing single pathed devices sdf {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ebf39a-1e7f-41cb-9171-8a44368b3c58]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_migrating.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-unplugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-44588416-88f1-44a9-913d-0b4270e4c2c1 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-44588416-88f1-44a9-913d-0b4270e4c2c1 for instance with vm_state active and task_state deleting.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-unplugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING nova.compute.manager [req-cfb80a45-0480-494c-8429-3d828df88730 req-80fec3eb-4ee5-44b2-a1d1-faa239c3fcda service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-decd4865-3f96-4ebc-8c49-2e6e3342c870 for instance with vm_state active and task_state deleting.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dc3580-f9c5-41d6-be21-71254b04b409]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Flushing IO for device /dev/sdf {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e0fcc2-1ace-4057-b43c-99e97cca3e0c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a861dd5-e20e-48c5-88db-4ea404db984f]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a72ee48-8921-49b5-9821-c102a2b0b81c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for cae1202f-0f6c-437e-8334-215b4736e061 due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112570.642281, cae1202f-0f6c-437e-8334-215b4736e061 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:50 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] VM Resumed (Lifecycle Event)
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f254ef35-6b74-42ad-b9f9-1b0fa834204a tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af69026-2fbc-4b6c-a778-7f486d83b4a9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260]
Aug 27 05:02:50 user nova-compute[72904]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:50 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112570.6676424, cae1202f-0f6c-437e-8334-215b4736e061 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:50 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] VM Started (Lifecycle Event)
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91950a7d-c9fe-4606-b4ff-dd8f2cb31755 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dfac51-e024-44cc-adfa-77090b895211]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== disconnect_volume: return (412ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neLZcEoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:50 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2458080-c082-4b7e-9aac-762221b20294]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fb64db-2291-499e-a0db-93586030f5ea]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 (non-flash)
Aug 27 05:02:50 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7df760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199'): ({'sdg'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Removing single pathed devices sdg {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd7cab1-c1c6-4e7b-bda5-0fe5701ca1da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[19609760-0914-42ee-96e8-04eb4baa41ce]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Flushing IO for device /dev/sdg {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c26c6e-00c3-4f13-b110-3ba378a7ab46]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0acd7b1-b7f4-4b48-954b-dad4ab90dfe4]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] SCSI volumes sdg have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:02:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2033beb0-fec3-491e-ac43-b762fe661311]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeb06ef-c6bf-47fc-b81b-3ce3ed206a33]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260]
Aug 27 05:02:51 user nova-compute[72904]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199, portal: 172.16.0.220,3260] successful.
Aug 27 05:02:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d0e2668-10a3-4d0d-84c8-db0427991199 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a729d850-c485-4c38-87c9-daa192de5441]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] <== disconnect_volume: return (348ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:02:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Deleting instance files /opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b_del
Aug 27 05:02:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Deletion of /opt/stack/data/nova/instances/bd8444b2-1511-446b-8139-3809a4a12e5b_del complete
Aug 27 05:02:51 user nova-compute[72904]: INFO nova.compute.manager [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Took 4.28 seconds to destroy the instance on the hypervisor.
Aug 27 05:02:51 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:02:51 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:52 user nova-compute[72904]: WARNING nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-2ef82d54-e731-4761-82fa-49fcc3a33dc0 for instance with vm_state active and task_state deleting.
Aug 27 05:02:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-unplugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-unplugged-20686a0f-ec45-4c05-aae9-872242a5cd3e for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Acquiring lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] No waiting events found dispatching network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:52 user nova-compute[72904]: WARNING nova.compute.manager [req-428ca74a-0aec-4202-b3ce-f335acfb735e req-bed52f19-8f9c-4482-b0b1-1e027f82f81a service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received unexpected event network-vif-plugged-20686a0f-ec45-4c05-aae9-872242a5cd3e for instance with vm_state active and task_state deleting.
Aug 27 05:02:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-0eb67ee6-d247-4650-be4c-f48872abe371 req-0b9f6566-9d0f-4a35-959d-9e5782938fc9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-deleted-20686a0f-ec45-4c05-aae9-872242a5cd3e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:53 user nova-compute[72904]: INFO nova.compute.manager [req-0eb67ee6-d247-4650-be4c-f48872abe371 req-0b9f6566-9d0f-4a35-959d-9e5782938fc9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Neutron deleted interface 20686a0f-ec45-4c05-aae9-872242a5cd3e; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-0eb67ee6-d247-4650-be4c-f48872abe371 req-0b9f6566-9d0f-4a35-959d-9e5782938fc9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b6e6460-b500-4589-af0b-6927510c9e49", "address": "fa:16:3e:36:87:a1", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b6e6460-b5", "ovs_interfaceid": "2b6e6460-b500-4589-af0b-6927510c9e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-0eb67ee6-d247-4650-be4c-f48872abe371 req-0b9f6566-9d0f-4a35-959d-9e5782938fc9 service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Detach interface failed, port_id=20686a0f-ec45-4c05-aae9-872242a5cd3e, reason: Instance bd8444b2-1511-446b-8139-3809a4a12e5b could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:54 user nova-compute[72904]: INFO nova.compute.manager [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Terminating instance
Aug 27 05:02:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-010fac96-0f42-4ce3-8348-aeb83cc93b34 req-9a1cfc61-0dd5-4e67-bc69-b702a115ffda service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-vif-unplugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-010fac96-0f42-4ce3-8348-aeb83cc93b34 req-9a1cfc61-0dd5-4e67-bc69-b702a115ffda service nova] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-010fac96-0f42-4ce3-8348-aeb83cc93b34 req-9a1cfc61-0dd5-4e67-bc69-b702a115ffda service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-010fac96-0f42-4ce3-8348-aeb83cc93b34 req-9a1cfc61-0dd5-4e67-bc69-b702a115ffda service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-010fac96-0f42-4ce3-8348-aeb83cc93b34 req-9a1cfc61-0dd5-4e67-bc69-b702a115ffda service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] No waiting events found dispatching network-vif-unplugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-010fac96-0f42-4ce3-8348-aeb83cc93b34 req-9a1cfc61-0dd5-4e67-bc69-b702a115ffda service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-vif-unplugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:55 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Instance destroyed successfully.
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.objects.instance [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lazy-loading 'resources' on Instance uuid 72995227-dd52-4b04-a119-41c34dc2e43b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1181321178',display_name='tempest-VolumesAssistedSnapshotsTest-server-1181321178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1181321178',id=9,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCW9jVip3htRH3vqmeC6GmmURceEWcCNtEUdWyHOUrvJMFrDAr2nTKdopSuY7yQAizrYNdZ64pNKGMRoBwPJP7DVUDHO8PnlFrFfBb7xNlzZau2mQp7yi33cyYcPgIRgeg==',key_name='tempest-keypair-112656168',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a49b21d9c614de4b372252fab908b25',ramdisk_id='',reservation_id='r-e704d4yx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1073004250',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1073004250-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28c32ea246ad49f6aadbe75dce5a6b03',uuid=72995227-dd52-4b04-a119-41c34dc2e43b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Converting VIF {"id": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "address": "fa:16:3e:26:b6:fa", "network": {"id": "f1cfc312-7fab-4faa-9bdc-8472a7b941c6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1741310493-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a49b21d9c614de4b372252fab908b25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf207583-66", "ovs_interfaceid": "bf207583-6614-42c4-8d4a-1c22ff7d62e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:b6:fa,bridge_name='br-int',has_traffic_filtering=True,id=bf207583-6614-42c4-8d4a-1c22ff7d62e9,network=Network(f1cfc312-7fab-4faa-9bdc-8472a7b941c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf207583-66') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG os_vif [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:b6:fa,bridge_name='br-int',has_traffic_filtering=True,id=bf207583-6614-42c4-8d4a-1c22ff7d62e9,network=Network(f1cfc312-7fab-4faa-9bdc-8472a7b941c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf207583-66') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf207583-66, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:02:55 user nova-compute[72904]: INFO os_vif [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:b6:fa,bridge_name='br-int',has_traffic_filtering=True,id=bf207583-6614-42c4-8d4a-1c22ff7d62e9,network=Network(f1cfc312-7fab-4faa-9bdc-8472a7b941c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf207583-66')
Aug 27 05:02:55 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Deleting instance files /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b_del
Aug 27 05:02:55 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Deletion of /opt/stack/data/nova/instances/72995227-dd52-4b04-a119-41c34dc2e43b_del complete
Aug 27 05:02:55 user nova-compute[72904]: INFO nova.compute.manager [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 27 05:02:55 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-deleted-2b6e6460-b500-4589-af0b-6927510c9e49 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:55 user nova-compute[72904]: INFO nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Neutron deleted interface 2b6e6460-b500-4589-af0b-6927510c9e49; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.network.neutron [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "address": "fa:16:3e:41:12:e9", "network": {"id": "e7acb99f-fd8f-4013-b891-d69675ef0722", "bridge": "br-int", "label": "tempest-device-tagging-net2-1846877146", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8efd4c-6a", "ovs_interfaceid": "8d8efd4c-6aad-4bdf-b865-080a929bb813", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Detach interface failed, port_id=2b6e6460-b500-4589-af0b-6927510c9e49, reason: Instance bd8444b2-1511-446b-8139-3809a4a12e5b could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-deleted-8d8efd4c-6aad-4bdf-b865-080a929bb813 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:55 user nova-compute[72904]: INFO nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Neutron deleted interface 8d8efd4c-6aad-4bdf-b865-080a929bb813; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.network.neutron [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "address": "fa:16:3e:c3:91:43", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ef82d54-e7", "ovs_interfaceid": "2ef82d54-e731-4761-82fa-49fcc3a33dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Detach interface failed, port_id=8d8efd4c-6aad-4bdf-b865-080a929bb813, reason: Instance bd8444b2-1511-446b-8139-3809a4a12e5b could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-deleted-2ef82d54-e731-4761-82fa-49fcc3a33dc0 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:55 user nova-compute[72904]: INFO nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Neutron deleted interface 2ef82d54-e731-4761-82fa-49fcc3a33dc0; detaching it from the instance and deleting it from the info cache
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.network.neutron [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [{"id": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "address": "fa:16:3e:c2:3f:23", "network": {"id": "01db7bb6-6663-4f56-a0e1-1982c4584e7f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1070757350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b5cb8f-d3", "ovs_interfaceid": "04b5cb8f-d374-4b57-a4d6-59a6338f88ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44588416-88f1-44a9-913d-0b4270e4c2c1", "address": "fa:16:3e:2e:78:2a", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44588416-88", "ovs_interfaceid": "44588416-88f1-44a9-913d-0b4270e4c2c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "address": "fa:16:3e:28:76:0b", "network": {"id": "fbd69cbb-fd85-4dfd-a4bb-03c2c5d0f1f5", "bridge": "br-int", "label": "tempest-device-tagging-net1-351294006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3a6ee805ec6241d0a7159d2add36aa10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdecd4865-3f", "ovs_interfaceid": "decd4865-3f96-4ebc-8c49-2e6e3342c870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1ea339-5937-488f-ae05-60a8dcce9886 req-d953a234-dca8-401a-86b5-b1cc3f548aca service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Detach interface failed, port_id=2ef82d54-e731-4761-82fa-49fcc3a33dc0, reason: Instance bd8444b2-1511-446b-8139-3809a4a12e5b could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Port f4285663-09bc-421f-9017-4c18cf096612 binding to destination host user is already ACTIVE {{(pid=72904) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 05:02:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:56 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Took 5.46 seconds to deallocate network for instance.
Aug 27 05:02:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-d198e65a-ee74-44b9-b373-7147d1542273 req-57d8f5e6-efad-4384-a7ec-b441bddb4cb9 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d198e65a-ee74-44b9-b373-7147d1542273 req-57d8f5e6-efad-4384-a7ec-b441bddb4cb9 service nova] Acquiring lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d198e65a-ee74-44b9-b373-7147d1542273 req-57d8f5e6-efad-4384-a7ec-b441bddb4cb9 service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d198e65a-ee74-44b9-b373-7147d1542273 req-57d8f5e6-efad-4384-a7ec-b441bddb4cb9 service nova] Lock "72995227-dd52-4b04-a119-41c34dc2e43b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-d198e65a-ee74-44b9-b373-7147d1542273 req-57d8f5e6-efad-4384-a7ec-b441bddb4cb9 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] No waiting events found dispatching network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:02:56 user nova-compute[72904]: WARNING nova.compute.manager [req-d198e65a-ee74-44b9-b373-7147d1542273 req-57d8f5e6-efad-4384-a7ec-b441bddb4cb9 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received unexpected event network-vif-plugged-bf207583-6614-42c4-8d4a-1c22ff7d62e9 for instance with vm_state active and task_state deleting.
Aug 27 05:02:57 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112562.2456622, e165c9ab-f2e0-43b4-bdcd-d92abd46c424 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:02:57 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] VM Stopped (Lifecycle Event)
Aug 27 05:02:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-50fb79df-c4f7-4c0e-81d7-9033d10e81c3 None None] [instance: e165c9ab-f2e0-43b4-bdcd-d92abd46c424] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-319db25c-a5e0-4df6-aacf-e513a4906e62 req-bad129d3-4849-4e57-b769-a7e04f52e85d service nova] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Received event network-vif-deleted-04b5cb8f-d374-4b57-a4d6-59a6338f88ae {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:02:57 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Took 2.66 seconds to deallocate network for instance.
Aug 27 05:02:57 user nova-compute[72904]: DEBUG os_brick.utils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-bdedd942-bafe-4449-abdd-1db6f728bae8 req-2676fe54-381f-464f-9978-dafe3c24ace7 service nova] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Received event network-vif-deleted-bf207583-6614-42c4-8d4a-1c22ff7d62e9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[09611798-7ed9-4ca2-b01a-c91a844d134e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8765d5-5ecf-4ed4-a20c-2d2ca791895d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3caccc0-5bbf-4919-ba06-8dfa43160a07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa625b70-21ff-4b8d-b941-d089018ffbf6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:02:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:02:58 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:02:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a116bb-4c94-4130-80d9-d1fcde88ac62]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG os_brick.utils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:58 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Deleted allocations for instance 72995227-dd52-4b04-a119-41c34dc2e43b
Aug 27 05:02:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-61e94eb6-2bea-40cb-9bb4-f9485f15e872 tempest-VolumesAssistedSnapshotsTest-1073004250 tempest-VolumesAssistedSnapshotsTest-1073004250-project-member] Lock "72995227-dd52-4b04-a119-41c34dc2e43b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.323s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:02:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:02:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:02 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112567.1142278, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:03:02 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Stopped (Lifecycle Event)
Aug 27 05:03:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e65bffef-d45b-43d0-bad1-c5e5dd3e1698 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:03:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e65bffef-d45b-43d0-bad1-c5e5dd3e1698 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:03:02 user nova-compute[72904]: INFO nova.compute.manager [None req-e65bffef-d45b-43d0-bad1-c5e5dd3e1698 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 05:03:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:03 user nova-compute[72904]: INFO nova.compute.manager [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Terminating instance
Aug 27 05:03:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112569.022159, bd8444b2-1511-446b-8139-3809a4a12e5b => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:03:04 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] VM Stopped (Lifecycle Event)
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-df31a8c7-ea3b-4c01-adea-836ed0ea2e73 None None] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Instance destroyed successfully.
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lazy-loading 'resources' on Instance uuid 3853715e-fce2-4c7c-b2a1-b8875866e0e8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2035711756',display_name='tempest-TestVolumeSwap-server-2035711756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2035711756',id=5,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNG5tbNsTozwwOnECGSs75JugxZ7RFsybYiUzavaqNwtsph4/BrBgkRw4vTKnUd+27e2W89Qpvrg1c0PErbqulh4VKfZS/KS2/KW3hhzHsRZk97at26jd1ojPO0rZjlUhw==',key_name='tempest-keypair-1212211526',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d39e559d3e346078cd876c7f09913eb',ramdisk_id='',reservation_id='r-byk0xos9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1120456123',owner_user_name='tempest-TestVolumeSwap-1120456123-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='009cdc58f61f4837ab8d4ee79d8b2a5d',uuid=3853715e-fce2-4c7c-b2a1-b8875866e0e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Converting VIF {"id": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "address": "fa:16:3e:08:c5:91", "network": {"id": "bde7ad3f-f2d3-4565-b777-00d2c70feddc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1289166643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d39e559d3e346078cd876c7f09913eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6031cf82-e9", "ovs_interfaceid": "6031cf82-e9e2-4c84-bac3-27d01d92c0fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:c5:91,bridge_name='br-int',has_traffic_filtering=True,id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc,network=Network(bde7ad3f-f2d3-4565-b777-00d2c70feddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6031cf82-e9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG os_vif [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:c5:91,bridge_name='br-int',has_traffic_filtering=True,id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc,network=Network(bde7ad3f-f2d3-4565-b777-00d2c70feddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6031cf82-e9') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6031cf82-e9, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:03:04 user nova-compute[72904]: INFO os_vif [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:c5:91,bridge_name='br-int',has_traffic_filtering=True,id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc,network=Network(bde7ad3f-f2d3-4565-b777-00d2c70feddc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6031cf82-e9')
Aug 27 05:03:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Deleting instance files /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8_del
Aug 27 05:03:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Deletion of /opt/stack/data/nova/instances/3853715e-fce2-4c7c-b2a1-b8875866e0e8_del complete
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-1b1483eb-d2d2-4e98-8d82-7b4d03f88a13 req-1543fa2a-92e7-41d1-bfd1-b9ff00b6f8bd service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-vif-unplugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1b1483eb-d2d2-4e98-8d82-7b4d03f88a13 req-1543fa2a-92e7-41d1-bfd1-b9ff00b6f8bd service nova] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1b1483eb-d2d2-4e98-8d82-7b4d03f88a13 req-1543fa2a-92e7-41d1-bfd1-b9ff00b6f8bd service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1b1483eb-d2d2-4e98-8d82-7b4d03f88a13 req-1543fa2a-92e7-41d1-bfd1-b9ff00b6f8bd service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-1b1483eb-d2d2-4e98-8d82-7b4d03f88a13 req-1543fa2a-92e7-41d1-bfd1-b9ff00b6f8bd service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] No waiting events found dispatching network-vif-unplugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-1b1483eb-d2d2-4e98-8d82-7b4d03f88a13 req-1543fa2a-92e7-41d1-bfd1-b9ff00b6f8bd service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-vif-unplugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:03:04 user nova-compute[72904]: INFO nova.compute.manager [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 27 05:03:04 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:03:04 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:03:06 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Took 1.37 seconds to deallocate network for instance.
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-7df22528-2f20-4289-a0f9-bf52a968d448 req-f8e458df-b8b0-4bb5-9b87-5abc1dd42caa service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-vif-deleted-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:03:06 user nova-compute[72904]: INFO nova.compute.manager [req-7df22528-2f20-4289-a0f9-bf52a968d448 req-f8e458df-b8b0-4bb5-9b87-5abc1dd42caa service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Neutron deleted interface 6031cf82-e9e2-4c84-bac3-27d01d92c0fc; detaching it from the instance and deleting it from the info cache
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-7df22528-2f20-4289-a0f9-bf52a968d448 req-f8e458df-b8b0-4bb5-9b87-5abc1dd42caa service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-7df22528-2f20-4289-a0f9-bf52a968d448 req-f8e458df-b8b0-4bb5-9b87-5abc1dd42caa service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Detach interface failed, port_id=6031cf82-e9e2-4c84-bac3-27d01d92c0fc, reason: Instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:06 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Deleted allocations for instance 3853715e-fce2-4c7c-b2a1-b8875866e0e8
Aug 27 05:03:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-05fdf351-b3ae-4054-9e43-0cb66b057c9c tempest-TestVolumeSwap-1120456123 tempest-TestVolumeSwap-1120456123-project-member] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.929s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-d45fa140-98de-4380-b9f5-9b9fa6222ee4 req-28c96365-0440-4b22-865c-e958827b8683 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received event network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d45fa140-98de-4380-b9f5-9b9fa6222ee4 req-28c96365-0440-4b22-865c-e958827b8683 service nova] Acquiring lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d45fa140-98de-4380-b9f5-9b9fa6222ee4 req-28c96365-0440-4b22-865c-e958827b8683 service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d45fa140-98de-4380-b9f5-9b9fa6222ee4 req-28c96365-0440-4b22-865c-e958827b8683 service nova] Lock "3853715e-fce2-4c7c-b2a1-b8875866e0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-d45fa140-98de-4380-b9f5-9b9fa6222ee4 req-28c96365-0440-4b22-865c-e958827b8683 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] No waiting events found dispatching network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:03:06 user nova-compute[72904]: WARNING nova.compute.manager [req-d45fa140-98de-4380-b9f5-9b9fa6222ee4 req-28c96365-0440-4b22-865c-e958827b8683 service nova] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Received unexpected event network-vif-plugged-6031cf82-e9e2-4c84-bac3-27d01d92c0fc for instance with vm_state deleted and task_state None.
Aug 27 05:03:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:10 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112575.027324, 72995227-dd52-4b04-a119-41c34dc2e43b => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:03:10 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] VM Stopped (Lifecycle Event)
Aug 27 05:03:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f06237cd-0bf9-4878-a073-f4ba5692c2b1 None None] [instance: 72995227-dd52-4b04-a119-41c34dc2e43b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:03:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Starting finish_migration {{(pid=72904) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:03:12 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Creating image(s)
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk. size=21474836480 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk 21474836480 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk 21474836480" returned: 0 in 0.046s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Ensure instance console log exists: /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Start _get_guest_xml network_info=[{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2120101558-network", "vif_mac": "fa:16:3e:67:1b:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8aa4796f-2105-4075-9f5f-2ff22b832c02', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd57daa0e-5ce0-47cb-90f1-c4327bca54a0', 'attached_at': '2023-08-27T05:03:12.000000', 'detached_at': '', 'volume_id': 'b1f7d270-cd66-43e6-8000-a5fed172d681', 'serial': 'b1f7d270-cd66-43e6-8000-a5fed172d681'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:03:12 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:03:12 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:03:12 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:03:12 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:03:12 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f766f9d-8977-42a2-88fe-73c52e9c5940]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:03:12 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[478be603-4287-4f41-a81d-29cf2cc4c7f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681] added
Aug 27 05:03:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[218a4e8f-f00e-4e15-8ae1-e889e4a5961b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[818f684c-f3a4-4796-9f7e-fa0bfd879222]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQYhIgd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQYhIgd" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa9f17a-0c08-43cd-8868-c8956d54c19c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZwQYhIgd'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61bb470-7450-4e12-bb76-0985eb32bb96]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aeb33d-f3a8-4333-a20b-b2b13bde0031]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d32ed7e-2087-46dd-9d7f-9b8827a35852 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:03:12 user nova-compute[72904]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d32ed7e-2087-46dd-9d7f-9b8827a35852 (non-flash)
Aug 27 05:03:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:03:12 user nova-compute[72904]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d32ed7e-2087-46dd-9d7f-9b8827a35852 (non-flash)
Aug 27 05:03:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d259b9-f193-4f46-81f5-c6b7ba29be51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]
Aug 27 05:03:12 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.
Aug 27 05:03:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9cb12c-b2c0-42d3-a4f4-b1bada23a77a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e08864-7827-4711-9333-0d762784a6d3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d32ed7e-2087-46dd-9d7f-9b8827a35852 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:03:13 user nova-compute[72904]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d32ed7e-2087-46dd-9d7f-9b8827a35852 (non-flash)
Aug 27 05:03:13 user nova-compute[72904]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:03:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:03:13 user nova-compute[72904]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d32ed7e-2087-46dd-9d7f-9b8827a35852 (non-flash)
Aug 27 05:03:13 user nova-compute[72904]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:03:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[73969701-9288-45d4-91c7-98fb1e036104]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:03:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26138366665646438', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138366665646438', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:58:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2120101558-network", "vif_mac": "fa:16:3e:67:1b:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2120101558-network", "vif_mac": "fa:16:3e:67:1b:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:03:14 user nova-compute[72904]:   <uuid>d57daa0e-5ce0-47cb-90f1-c4327bca54a0</uuid>
Aug 27 05:03:14 user nova-compute[72904]:   <name>instance-00000004</name>
Aug 27 05:03:14 user nova-compute[72904]:   <memory>2097152</memory>
Aug 27 05:03:14 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:03:14 user nova-compute[72904]:   <metadata>
Aug 27 05:03:14 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:03:14 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:03:14 user nova-compute[72904]:       <nova:name>tempest-ServerActionsTestOtherB-server-1845492887</nova:name>
Aug 27 05:03:14 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:03:12</nova:creationTime>
Aug 27 05:03:14 user nova-compute[72904]:       <nova:flavor name="m1.small">
Aug 27 05:03:14 user nova-compute[72904]:         <nova:memory>2048</nova:memory>
Aug 27 05:03:14 user nova-compute[72904]:         <nova:disk>20</nova:disk>
Aug 27 05:03:14 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:03:14 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:03:14 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:03:14 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:03:14 user nova-compute[72904]:       <nova:owner>
Aug 27 05:03:14 user nova-compute[72904]:         <nova:user uuid="58fce22ad00e47498c3cd80b3b6fe458">tempest-ServerActionsTestOtherB-30211083-project-member</nova:user>
Aug 27 05:03:14 user nova-compute[72904]:         <nova:project uuid="3e36dfaf419f4b78820a3536c6f65ad5">tempest-ServerActionsTestOtherB-30211083</nova:project>
Aug 27 05:03:14 user nova-compute[72904]:       </nova:owner>
Aug 27 05:03:14 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:03:14 user nova-compute[72904]:       <nova:ports>
Aug 27 05:03:14 user nova-compute[72904]:         <nova:port uuid="f4285663-09bc-421f-9017-4c18cf096612">
Aug 27 05:03:14 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 05:03:14 user nova-compute[72904]:         </nova:port>
Aug 27 05:03:14 user nova-compute[72904]:       </nova:ports>
Aug 27 05:03:14 user nova-compute[72904]:     </nova:instance>
Aug 27 05:03:14 user nova-compute[72904]:   </metadata>
Aug 27 05:03:14 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:03:14 user nova-compute[72904]:     <system>
Aug 27 05:03:14 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:03:14 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:03:14 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:03:14 user nova-compute[72904]:       <entry name="serial">d57daa0e-5ce0-47cb-90f1-c4327bca54a0</entry>
Aug 27 05:03:14 user nova-compute[72904]:       <entry name="uuid">d57daa0e-5ce0-47cb-90f1-c4327bca54a0</entry>
Aug 27 05:03:14 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:03:14 user nova-compute[72904]:     </system>
Aug 27 05:03:14 user nova-compute[72904]:   </sysinfo>
Aug 27 05:03:14 user nova-compute[72904]:   <os>
Aug 27 05:03:14 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:03:14 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:03:14 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:03:14 user nova-compute[72904]:   </os>
Aug 27 05:03:14 user nova-compute[72904]:   <features>
Aug 27 05:03:14 user nova-compute[72904]:     <acpi/>
Aug 27 05:03:14 user nova-compute[72904]:     <apic/>
Aug 27 05:03:14 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:03:14 user nova-compute[72904]:   </features>
Aug 27 05:03:14 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:03:14 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:03:14 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:03:14 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:03:14 user nova-compute[72904]:   </clock>
Aug 27 05:03:14 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:03:14 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:03:14 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:03:14 user nova-compute[72904]:   </cpu>
Aug 27 05:03:14 user nova-compute[72904]:   <devices>
Aug 27 05:03:14 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:03:14 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:03:14 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk"/>
Aug 27 05:03:14 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:03:14 user nova-compute[72904]:     </disk>
Aug 27 05:03:14 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:03:14 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:03:14 user nova-compute[72904]:       <source dev="/dev/sdd"/>
Aug 27 05:03:14 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:03:14 user nova-compute[72904]:       <serial>b1f7d270-cd66-43e6-8000-a5fed172d681</serial>
Aug 27 05:03:14 user nova-compute[72904]:     </disk>
Aug 27 05:03:14 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:03:14 user nova-compute[72904]:       <mac address="fa:16:3e:67:1b:45"/>
Aug 27 05:03:14 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:03:14 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:03:14 user nova-compute[72904]:       <target dev="tapf4285663-09"/>
Aug 27 05:03:14 user nova-compute[72904]:     </interface>
Aug 27 05:03:14 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:03:14 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/console.log" append="off"/>
Aug 27 05:03:14 user nova-compute[72904]:     </serial>
Aug 27 05:03:14 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:03:14 user nova-compute[72904]:     <video>
Aug 27 05:03:14 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:03:14 user nova-compute[72904]:     </video>
Aug 27 05:03:14 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:03:14 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:03:14 user nova-compute[72904]:     </rng>
Aug 27 05:03:14 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:03:14 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:03:14 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:03:14 user nova-compute[72904]:     </memballoon>
Aug 27 05:03:14 user nova-compute[72904]:   </devices>
Aug 27 05:03:14 user nova-compute[72904]: </domain>
Aug 27 05:03:14 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:58:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2120101558-network", "vif_mac": "fa:16:3e:67:1b:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2120101558-network", "vif_mac": "fa:16:3e:67:1b:45"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG os_vif [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4285663-09, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4285663-09, col_values=(('external_ids', {'iface-id': 'f4285663-09bc-421f-9017-4c18cf096612', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:1b:45', 'vm-uuid': 'd57daa0e-5ce0-47cb-90f1-c4327bca54a0'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:14 user nova-compute[72904]: INFO os_vif [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09')
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:03:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] No VIF found with MAC fa:16:3e:67:1b:45, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:03:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-321aa9a1-1697-4cde-bf7b-007199e83d6b req-367e2c30-b86a-4144-85c0-0ea20077f0b7 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:03:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-321aa9a1-1697-4cde-bf7b-007199e83d6b req-367e2c30-b86a-4144-85c0-0ea20077f0b7 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-321aa9a1-1697-4cde-bf7b-007199e83d6b req-367e2c30-b86a-4144-85c0-0ea20077f0b7 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-321aa9a1-1697-4cde-bf7b-007199e83d6b req-367e2c30-b86a-4144-85c0-0ea20077f0b7 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-321aa9a1-1697-4cde-bf7b-007199e83d6b req-367e2c30-b86a-4144-85c0-0ea20077f0b7 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:03:15 user nova-compute[72904]: WARNING nova.compute.manager [req-321aa9a1-1697-4cde-bf7b-007199e83d6b req-367e2c30-b86a-4144-85c0-0ea20077f0b7 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_finish.
Aug 27 05:03:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112597.818054, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:03:17 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Resumed (Lifecycle Event)
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:03:17 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance running successfully.
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Failed to set time: agent not configured {{(pid=72904) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3f09d3f4-346e-4d0d-a5d8-c7d0bfe7c539 tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] finish_migration finished successfully. {{(pid=72904) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:03:17 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112597.819786, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:03:17 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Started (Lifecycle Event)
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-7ac06a00-d439-4d98-b2e0-aa4e91833bf2 req-26ece4e5-bbf5-4f63-bf72-29360d930232 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7ac06a00-d439-4d98-b2e0-aa4e91833bf2 req-26ece4e5-bbf5-4f63-bf72-29360d930232 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7ac06a00-d439-4d98-b2e0-aa4e91833bf2 req-26ece4e5-bbf5-4f63-bf72-29360d930232 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7ac06a00-d439-4d98-b2e0-aa4e91833bf2 req-26ece4e5-bbf5-4f63-bf72-29360d930232 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-7ac06a00-d439-4d98-b2e0-aa4e91833bf2 req-26ece4e5-bbf5-4f63-bf72-29360d930232 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:03:17 user nova-compute[72904]: WARNING nova.compute.manager [req-7ac06a00-d439-4d98-b2e0-aa4e91833bf2 req-26ece4e5-bbf5-4f63-bf72-29360d930232 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state resize_finish.
Aug 27 05:03:17 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 05:03:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:19 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:03:19 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112584.7036824, 3853715e-fce2-4c7c-b2a1-b8875866e0e8 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:03:19 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] VM Stopped (Lifecycle Event)
Aug 27 05:03:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6aec5e05-24f1-4a49-8d26-487740a8c499 None None] [instance: 3853715e-fce2-4c7c-b2a1-b8875866e0e8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:03:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:03:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:03:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:03:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updating instance_info_cache with network_info: [{"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-660b1c77-120e-40d5-b698-b89ec506caf3" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:22 user nova-compute[72904]: INFO nova.compute.manager [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] [instance: bd8444b2-1511-446b-8139-3809a4a12e5b] Took 25.38 seconds to detach 3 volumes for instance.
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:22 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Deleted allocations for instance bd8444b2-1511-446b-8139-3809a4a12e5b
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49adad19-e6f1-4a91-8297-335fb12491a6 tempest-TaggedBootDevicesTest_v242-96474791 tempest-TaggedBootDevicesTest_v242-96474791-project-member] Lock "bd8444b2-1511-446b-8139-3809a4a12e5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 35.781s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:03:24 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:03:24 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7902MB free_disk=25.738025665283203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Applying migration context for instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 as it has an incoming, in-progress migration ed9e1e09-f8cf-4775-816c-a283848607bb. Migration status is finished {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 05:03:24 user nova-compute[72904]: INFO nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating resource usage from migration ed9e1e09-f8cf-4775-816c-a283848607bb
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance cae1202f-0f6c-437e-8334-215b4736e061 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 660b1c77-120e-40d5-b698-b89ec506caf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c6e4a49-6715-4e80-b593-de2b720ae255 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Migration ed9e1e09-f8cf-4775-816c-a283848607bb is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:03:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:03:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:03:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:03:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:03:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:03:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:03:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:03:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:03:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:04:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:15 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:04:15 user nova-compute[72904]: INFO nova.compute.claims [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Claim successful on node user
Aug 27 05:04:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:04:16 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.policy [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a89184799414da9ac135289cc4781ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a569f1146db846d7aabf09b5ca515d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:04:16 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Creating image(s)
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.221s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk 1073741824" returned: 0 in 0.064s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Successfully created port: d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.208s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Cannot resize image /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Ensure instance console log exists: /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Successfully updated port: d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquired lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-changed-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Refreshing instance network info cache due to event network-changed-d634d4ec-3655-45de-860f-ba7e1a7e3455. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] Acquiring lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Releasing lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance network_info: |[{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] Acquired lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.network.neutron [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Refreshing network info cache for port d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Start _get_guest_xml network_info=[{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:04:18 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:04:18 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:04:18 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'pci_devices' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:04:19 user nova-compute[72904]:   <uuid>ba4f9f20-2e95-465f-9b3f-4b4712b199ca</uuid>
Aug 27 05:04:19 user nova-compute[72904]:   <name>instance-0000000e</name>
Aug 27 05:04:19 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:04:19 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:04:19 user nova-compute[72904]:   <metadata>
Aug 27 05:04:19 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:04:19 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:04:19 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeTestJSON-server-1389826246</nova:name>
Aug 27 05:04:19 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:04:18</nova:creationTime>
Aug 27 05:04:19 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:04:19 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:04:19 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:04:19 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:04:19 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:04:19 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:04:19 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:04:19 user nova-compute[72904]:       <nova:owner>
Aug 27 05:04:19 user nova-compute[72904]:         <nova:user uuid="7a89184799414da9ac135289cc4781ed">tempest-AttachVolumeTestJSON-111990947-project-member</nova:user>
Aug 27 05:04:19 user nova-compute[72904]:         <nova:project uuid="a569f1146db846d7aabf09b5ca515d2d">tempest-AttachVolumeTestJSON-111990947</nova:project>
Aug 27 05:04:19 user nova-compute[72904]:       </nova:owner>
Aug 27 05:04:19 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:04:19 user nova-compute[72904]:       <nova:ports>
Aug 27 05:04:19 user nova-compute[72904]:         <nova:port uuid="d634d4ec-3655-45de-860f-ba7e1a7e3455">
Aug 27 05:04:19 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:04:19 user nova-compute[72904]:         </nova:port>
Aug 27 05:04:19 user nova-compute[72904]:       </nova:ports>
Aug 27 05:04:19 user nova-compute[72904]:     </nova:instance>
Aug 27 05:04:19 user nova-compute[72904]:   </metadata>
Aug 27 05:04:19 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:04:19 user nova-compute[72904]:     <system>
Aug 27 05:04:19 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:04:19 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:04:19 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:04:19 user nova-compute[72904]:       <entry name="serial">ba4f9f20-2e95-465f-9b3f-4b4712b199ca</entry>
Aug 27 05:04:19 user nova-compute[72904]:       <entry name="uuid">ba4f9f20-2e95-465f-9b3f-4b4712b199ca</entry>
Aug 27 05:04:19 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:04:19 user nova-compute[72904]:     </system>
Aug 27 05:04:19 user nova-compute[72904]:   </sysinfo>
Aug 27 05:04:19 user nova-compute[72904]:   <os>
Aug 27 05:04:19 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:04:19 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:04:19 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:04:19 user nova-compute[72904]:   </os>
Aug 27 05:04:19 user nova-compute[72904]:   <features>
Aug 27 05:04:19 user nova-compute[72904]:     <acpi/>
Aug 27 05:04:19 user nova-compute[72904]:     <apic/>
Aug 27 05:04:19 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:04:19 user nova-compute[72904]:   </features>
Aug 27 05:04:19 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:04:19 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:04:19 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:04:19 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:04:19 user nova-compute[72904]:   </clock>
Aug 27 05:04:19 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:04:19 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:04:19 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:04:19 user nova-compute[72904]:   </cpu>
Aug 27 05:04:19 user nova-compute[72904]:   <devices>
Aug 27 05:04:19 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:04:19 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:04:19 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk"/>
Aug 27 05:04:19 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:04:19 user nova-compute[72904]:     </disk>
Aug 27 05:04:19 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:04:19 user nova-compute[72904]:       <mac address="fa:16:3e:18:1b:7a"/>
Aug 27 05:04:19 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:04:19 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:04:19 user nova-compute[72904]:       <target dev="tapd634d4ec-36"/>
Aug 27 05:04:19 user nova-compute[72904]:     </interface>
Aug 27 05:04:19 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:04:19 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/console.log" append="off"/>
Aug 27 05:04:19 user nova-compute[72904]:     </serial>
Aug 27 05:04:19 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:04:19 user nova-compute[72904]:     <video>
Aug 27 05:04:19 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:04:19 user nova-compute[72904]:     </video>
Aug 27 05:04:19 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:04:19 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:04:19 user nova-compute[72904]:     </rng>
Aug 27 05:04:19 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:04:19 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:04:19 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:04:19 user nova-compute[72904]:     </memballoon>
Aug 27 05:04:19 user nova-compute[72904]:   </devices>
Aug 27 05:04:19 user nova-compute[72904]: </domain>
Aug 27 05:04:19 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG os_vif [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd634d4ec-36, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd634d4ec-36, col_values=(('external_ids', {'iface-id': 'd634d4ec-3655-45de-860f-ba7e1a7e3455', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:1b:7a', 'vm-uuid': 'ba4f9f20-2e95-465f-9b3f-4b4712b199ca'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:04:19 user nova-compute[72904]: INFO os_vif [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36')
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No VIF found with MAC fa:16:3e:18:1b:7a, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updated VIF entry in instance network info cache for port d634d4ec-3655-45de-860f-ba7e1a7e3455. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-68ae20bc-9927-450a-8637-f7f44aae2202 req-0574e46f-4126-4eb7-8aeb-790407cdb935 service nova] Releasing lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:04:19 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-376fed27-75fb-4fb8-a74e-0b6570f42200 req-90c76ea5-3860-483a-87a5-17a46dfdc4ff service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-376fed27-75fb-4fb8-a74e-0b6570f42200 req-90c76ea5-3860-483a-87a5-17a46dfdc4ff service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-376fed27-75fb-4fb8-a74e-0b6570f42200 req-90c76ea5-3860-483a-87a5-17a46dfdc4ff service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-376fed27-75fb-4fb8-a74e-0b6570f42200 req-90c76ea5-3860-483a-87a5-17a46dfdc4ff service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-376fed27-75fb-4fb8-a74e-0b6570f42200 req-90c76ea5-3860-483a-87a5-17a46dfdc4ff service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:21 user nova-compute[72904]: WARNING nova.compute.manager [req-376fed27-75fb-4fb8-a74e-0b6570f42200 req-90c76ea5-3860-483a-87a5-17a46dfdc4ff service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state building and task_state spawning.
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-e243b8f7-0be3-46b4-903f-294489da5c6f req-694fa303-54b1-4ee3-927b-80a06f5007bd service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e243b8f7-0be3-46b4-903f-294489da5c6f req-694fa303-54b1-4ee3-927b-80a06f5007bd service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e243b8f7-0be3-46b4-903f-294489da5c6f req-694fa303-54b1-4ee3-927b-80a06f5007bd service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e243b8f7-0be3-46b4-903f-294489da5c6f req-694fa303-54b1-4ee3-927b-80a06f5007bd service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-e243b8f7-0be3-46b4-903f-294489da5c6f req-694fa303-54b1-4ee3-927b-80a06f5007bd service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:23 user nova-compute[72904]: WARNING nova.compute.manager [req-e243b8f7-0be3-46b4-903f-294489da5c6f req-694fa303-54b1-4ee3-927b-80a06f5007bd service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state building and task_state spawning.
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112663.3895752, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Resumed (Lifecycle Event)
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.compute.manager [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Terminating instance
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance spawned successfully.
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112663.3913863, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Started (Lifecycle Event)
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Took 7.11 seconds to spawn the instance on the hypervisor.
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:23 user nova-compute[72904]: INFO nova.compute.manager [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Took 8.13 seconds to build instance.
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1afde50b-80af-4eac-9720-6d847038a855 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.251s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-81a50218-a9e9-44a7-9545-d271f3660a80 req-75893db3-8d9a-4f6c-bb9c-4527babd139a service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-unplugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81a50218-a9e9-44a7-9545-d271f3660a80 req-75893db3-8d9a-4f6c-bb9c-4527babd139a service nova] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81a50218-a9e9-44a7-9545-d271f3660a80 req-75893db3-8d9a-4f6c-bb9c-4527babd139a service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81a50218-a9e9-44a7-9545-d271f3660a80 req-75893db3-8d9a-4f6c-bb9c-4527babd139a service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-81a50218-a9e9-44a7-9545-d271f3660a80 req-75893db3-8d9a-4f6c-bb9c-4527babd139a service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] No waiting events found dispatching network-vif-unplugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-81a50218-a9e9-44a7-9545-d271f3660a80 req-75893db3-8d9a-4f6c-bb9c-4527babd139a service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-unplugged-90ef0071-ce6b-47e3-98ec-f47380c43632 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Instance destroyed successfully.
Aug 27 05:04:24 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lazy-loading 'resources' on Instance uuid 6c6e4a49-6715-4e80-b593-de2b720ae255 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1469146538',display_name='tempest-VolumesAdminNegativeTest-server-1469146538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1469146538',id=13,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97d22ddf3716486784e9bc8d39420d63',ramdisk_id='',reservation_id='r-42v7siq7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1562447872',owner_user_name='tempest-VolumesAdminNegativeTest-1562447872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:02:23Z,user_data=None,user_id='3aa245527faf42099b0bcefbad8e9a13',uuid=6c6e4a49-6715-4e80-b593-de2b720ae255,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converting VIF {"id": "90ef0071-ce6b-47e3-98ec-f47380c43632", "address": "fa:16:3e:14:db:3c", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90ef0071-ce", "ovs_interfaceid": "90ef0071-ce6b-47e3-98ec-f47380c43632", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:3c,bridge_name='br-int',has_traffic_filtering=True,id=90ef0071-ce6b-47e3-98ec-f47380c43632,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ef0071-ce') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG os_vif [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:3c,bridge_name='br-int',has_traffic_filtering=True,id=90ef0071-ce6b-47e3-98ec-f47380c43632,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ef0071-ce') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90ef0071-ce, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: INFO os_vif [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:3c,bridge_name='br-int',has_traffic_filtering=True,id=90ef0071-ce6b-47e3-98ec-f47380c43632,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90ef0071-ce')
Aug 27 05:04:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Deleting instance files /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255_del
Aug 27 05:04:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Deletion of /opt/stack/data/nova/instances/6c6e4a49-6715-4e80-b593-de2b720ae255_del complete
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: INFO nova.compute.manager [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:04:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7845MB free_disk=25.72168731689453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Applying migration context for instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 as it has an incoming, in-progress migration ed9e1e09-f8cf-4775-816c-a283848607bb. Migration status is finished {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 05:04:25 user nova-compute[72904]: INFO nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating resource usage from migration ed9e1e09-f8cf-4775-816c-a283848607bb
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance cae1202f-0f6c-437e-8334-215b4736e061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 660b1c77-120e-40d5-b698-b89ec506caf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c6e4a49-6715-4e80-b593-de2b720ae255 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Migration ed9e1e09-f8cf-4775-816c-a283848607bb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:04:25 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] No waiting events found dispatching network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:26 user nova-compute[72904]: WARNING nova.compute.manager [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received unexpected event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 for instance with vm_state active and task_state deleting.
Aug 27 05:04:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] No waiting events found dispatching network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:26 user nova-compute[72904]: WARNING nova.compute.manager [req-58df20e1-3062-48a3-99f3-65e96941c19f req-545df6b1-91ac-4033-95d2-6977d99b2dfb service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received unexpected event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 for instance with vm_state active and task_state deleting.
Aug 27 05:04:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.963s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:27 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Took 2.51 seconds to deallocate network for instance.
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: WARNING nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 9ca0a7be-bc37-473c-8523-4808a76a1b5d {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 660b1c77-120e-40d5-b698-b89ec506caf3 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 6c6e4a49-6715-4e80-b593-de2b720ae255 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "cae1202f-0f6c-437e-8334-215b4736e061" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "cae1202f-0f6c-437e-8334-215b4736e061" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:27 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Deleted allocations for instance 6c6e4a49-6715-4e80-b593-de2b720ae255
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3587353-5332-4a80-a59a-5ae4b40d0d13 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.466s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.403s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] No waiting events found dispatching network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:28 user nova-compute[72904]: WARNING nova.compute.manager [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received unexpected event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 for instance with vm_state deleted and task_state None.
Aug 27 05:04:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] Acquiring lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] Lock "6c6e4a49-6715-4e80-b593-de2b720ae255-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] No waiting events found dispatching network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:28 user nova-compute[72904]: WARNING nova.compute.manager [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received unexpected event network-vif-plugged-90ef0071-ce6b-47e3-98ec-f47380c43632 for instance with vm_state deleted and task_state None.
Aug 27 05:04:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-322af252-17ee-4ecc-b470-b7e654c7cb73 req-314b049f-5e5e-4348-8bb1-9ec1ef4783b5 service nova] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Received event network-vif-deleted-90ef0071-ce6b-47e3-98ec-f47380c43632 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:31 user nova-compute[72904]: INFO nova.compute.manager [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Unrescuing
Aug 27 05:04:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:31 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:04:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:32 user nova-compute[72904]: DEBUG nova.objects.instance [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'flavor' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:04:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-9af6fcb5-4bbe-483a-89f5-39b27fe3c401 req-b82f133e-bcf3-4aca-8379-5b5fc6fa796e service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9af6fcb5-4bbe-483a-89f5-39b27fe3c401 req-b82f133e-bcf3-4aca-8379-5b5fc6fa796e service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9af6fcb5-4bbe-483a-89f5-39b27fe3c401 req-b82f133e-bcf3-4aca-8379-5b5fc6fa796e service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9af6fcb5-4bbe-483a-89f5-39b27fe3c401 req-b82f133e-bcf3-4aca-8379-5b5fc6fa796e service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-9af6fcb5-4bbe-483a-89f5-39b27fe3c401 req-b82f133e-bcf3-4aca-8379-5b5fc6fa796e service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:33 user nova-compute[72904]: WARNING nova.compute.manager [req-9af6fcb5-4bbe-483a-89f5-39b27fe3c401 req-b82f133e-bcf3-4aca-8379-5b5fc6fa796e service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:04:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:33 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance destroyed successfully.
Aug 27 05:04:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Port f4285663-09bc-421f-9017-4c18cf096612 binding to destination host user is already ACTIVE {{(pid=72904) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:04:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing instance network info cache due to event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:04:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:04:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e7853d7-e5f5-4b84-abbe-464903957a51 req-ecebd61b-a654-48b6-9f1a-12dffb7a3ac3 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e7853d7-e5f5-4b84-abbe-464903957a51 req-ecebd61b-a654-48b6-9f1a-12dffb7a3ac3 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e7853d7-e5f5-4b84-abbe-464903957a51 req-ecebd61b-a654-48b6-9f1a-12dffb7a3ac3 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e7853d7-e5f5-4b84-abbe-464903957a51 req-ecebd61b-a654-48b6-9f1a-12dffb7a3ac3 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e7853d7-e5f5-4b84-abbe-464903957a51 req-ecebd61b-a654-48b6-9f1a-12dffb7a3ac3 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:35 user nova-compute[72904]: WARNING nova.compute.manager [req-0e7853d7-e5f5-4b84-abbe-464903957a51 req-ecebd61b-a654-48b6-9f1a-12dffb7a3ac3 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:04:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Creating tmpfile /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/tmp7i83l94y to verify with other compute node that the instance is on the same shared storage. {{(pid=72904) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updated VIF entry in instance network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea57cce9-15c7-4e3c-b63e-8eea3c5e2b48 req-8ec4225a-ab4a-4f60-9fe9-015ee4a59bd6 service nova] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance destroyed successfully.
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.objects.instance [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lazy-loading 'resources' on Instance uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:03:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:03:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_vif [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4285663-09, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:04:36 user nova-compute[72904]: INFO os_vif [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09')
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:04:36 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd94a71-c272-460c-9acd-813f0524df97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9915dd-308c-431e-9b75-fbae35a9217f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:04:36 user nova-compute[72904]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:04:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:04:36 user nova-compute[72904]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:04:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c6860e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[995cc3bc-d70f-43ea-96f3-1c17a0da1a9b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e1c0d2-122f-4461-82be-0b68361488a8]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d58505-63b9-48dd-9dd8-bccc18501e5f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing instance network info cache due to event network-changed-25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] Acquiring lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] Acquired lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Refreshing network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.068s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc225d-b182-4992-82c5-3637f780ff6b]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab757984-e4be-4a5b-99b6-774aa29a2d06]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fc5cfe-6755-481d-ac12-7a200298362f]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]
Aug 27 05:04:36 user nova-compute[72904]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.
Aug 27 05:04:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[821a4728-5788-4952-919a-b8cc93f31058]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== disconnect_volume: return (353ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:04:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:37 user nova-compute[72904]: WARNING nova.compute.manager [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:37 user nova-compute[72904]: WARNING nova.compute.manager [req-7eaa77c8-cec7-45d9-806f-831734bbf9e4 req-61448247-8770-4c73-b7c8-8c6d8b984ab1 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updated VIF entry in instance network info cache for port 25f639bd-e92f-45c8-be05-fe92c4ee4e39. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [{"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] Releasing lock "refresh_cache-cae1202f-0f6c-437e-8334-215b4736e061" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:37 user nova-compute[72904]: WARNING nova.compute.manager [req-b305e5cf-2066-4a4b-b525-139f16512fde req-bbf25e13-f2b8-4d25-af7a-91134aa9b0eb service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state resized and task_state resize_reverting.
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for cae1202f-0f6c-437e-8334-215b4736e061 due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112678.5719037, cae1202f-0f6c-437e-8334-215b4736e061 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:38 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] VM Resumed (Lifecycle Event)
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3a0b84c3-5a1a-4077-9390-b7d40657ea01 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:04:38 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112678.573445, cae1202f-0f6c-437e-8334-215b4736e061 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:38 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] VM Started (Lifecycle Event)
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-936add8e-bdc5-4983-a70a-e4327ff1c409 req-c231133f-038d-4df1-b1f3-5fda9d7d9d9f service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-936add8e-bdc5-4983-a70a-e4327ff1c409 req-c231133f-038d-4df1-b1f3-5fda9d7d9d9f service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-936add8e-bdc5-4983-a70a-e4327ff1c409 req-c231133f-038d-4df1-b1f3-5fda9d7d9d9f service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-936add8e-bdc5-4983-a70a-e4327ff1c409 req-c231133f-038d-4df1-b1f3-5fda9d7d9d9f service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-936add8e-bdc5-4983-a70a-e4327ff1c409 req-c231133f-038d-4df1-b1f3-5fda9d7d9d9f service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:38 user nova-compute[72904]: WARNING nova.compute.manager [req-936add8e-bdc5-4983-a70a-e4327ff1c409 req-c231133f-038d-4df1-b1f3-5fda9d7d9d9f service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state resized and task_state resize_reverting.
Aug 27 05:04:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:39 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112664.3330352, 6c6e4a49-6715-4e80-b593-de2b720ae255 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:39 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] VM Stopped (Lifecycle Event)
Aug 27 05:04:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-20b2eef0-c0fd-460b-ae67-d72b8b3b62b3 None None] [instance: 6c6e4a49-6715-4e80-b593-de2b720ae255] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:04:44 user nova-compute[72904]: INFO nova.compute.claims [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Claim successful on node user
Aug 27 05:04:44 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:04:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:04:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG nova.policy [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4bbded3a71e4d6196d83c1fa5e7a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ae29302d54f8aa82e6c51bbfba65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:04:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Creating image(s)
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.217s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.221s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk 1073741824" returned: 0 in 0.060s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.228s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Successfully created port: a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Cannot resize image /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Ensure instance console log exists: /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.objects.instance [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lazy-loading 'migration_context' on Instance uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.objects.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Object Instance<d57daa0e-5ce0-47cb-90f1-c4327bca54a0> lazy-loaded attributes: resources,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Successfully updated port: a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received event network-changed-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Refreshing instance network info cache due to event network-changed-a99493e7-a32a-4126-ba01-7563e74bb14d. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] Acquiring lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.484s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updating instance_info_cache with network_info: [{"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Instance network_info: |[{"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] Acquired lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Refreshing network info cache for port a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Start _get_guest_xml network_info=[{"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:04:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:04:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1383886142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1383886142',id=15,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-5pyri6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:04:45Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=4fba85dc-5514-4bc1-a731-1cd1af6da152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:94:30,bridge_name='br-int',has_traffic_filtering=True,id=a99493e7-a32a-4126-ba01-7563e74bb14d,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99493e7-a3') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fba85dc-5514-4bc1-a731-1cd1af6da152 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:04:47 user nova-compute[72904]:   <uuid>4fba85dc-5514-4bc1-a731-1cd1af6da152</uuid>
Aug 27 05:04:47 user nova-compute[72904]:   <name>instance-0000000f</name>
Aug 27 05:04:47 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:04:47 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:04:47 user nova-compute[72904]:   <metadata>
Aug 27 05:04:47 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:04:47 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:04:47 user nova-compute[72904]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1383886142</nova:name>
Aug 27 05:04:47 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:04:47</nova:creationTime>
Aug 27 05:04:47 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:04:47 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:04:47 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:04:47 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:04:47 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:04:47 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:04:47 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:04:47 user nova-compute[72904]:       <nova:owner>
Aug 27 05:04:47 user nova-compute[72904]:         <nova:user uuid="f4bbded3a71e4d6196d83c1fa5e7a868">tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member</nova:user>
Aug 27 05:04:47 user nova-compute[72904]:         <nova:project uuid="da9ae29302d54f8aa82e6c51bbfba65d">tempest-ServerBootFromVolumeStableRescueTest-1493340065</nova:project>
Aug 27 05:04:47 user nova-compute[72904]:       </nova:owner>
Aug 27 05:04:47 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:04:47 user nova-compute[72904]:       <nova:ports>
Aug 27 05:04:47 user nova-compute[72904]:         <nova:port uuid="a99493e7-a32a-4126-ba01-7563e74bb14d">
Aug 27 05:04:47 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 05:04:47 user nova-compute[72904]:         </nova:port>
Aug 27 05:04:47 user nova-compute[72904]:       </nova:ports>
Aug 27 05:04:47 user nova-compute[72904]:     </nova:instance>
Aug 27 05:04:47 user nova-compute[72904]:   </metadata>
Aug 27 05:04:47 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:04:47 user nova-compute[72904]:     <system>
Aug 27 05:04:47 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:04:47 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:04:47 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:04:47 user nova-compute[72904]:       <entry name="serial">4fba85dc-5514-4bc1-a731-1cd1af6da152</entry>
Aug 27 05:04:47 user nova-compute[72904]:       <entry name="uuid">4fba85dc-5514-4bc1-a731-1cd1af6da152</entry>
Aug 27 05:04:47 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:04:47 user nova-compute[72904]:     </system>
Aug 27 05:04:47 user nova-compute[72904]:   </sysinfo>
Aug 27 05:04:47 user nova-compute[72904]:   <os>
Aug 27 05:04:47 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:04:47 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:04:47 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:04:47 user nova-compute[72904]:   </os>
Aug 27 05:04:47 user nova-compute[72904]:   <features>
Aug 27 05:04:47 user nova-compute[72904]:     <acpi/>
Aug 27 05:04:47 user nova-compute[72904]:     <apic/>
Aug 27 05:04:47 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:04:47 user nova-compute[72904]:   </features>
Aug 27 05:04:47 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:04:47 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:04:47 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:04:47 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:04:47 user nova-compute[72904]:   </clock>
Aug 27 05:04:47 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:04:47 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:04:47 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:04:47 user nova-compute[72904]:   </cpu>
Aug 27 05:04:47 user nova-compute[72904]:   <devices>
Aug 27 05:04:47 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:04:47 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:04:47 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk"/>
Aug 27 05:04:47 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:04:47 user nova-compute[72904]:     </disk>
Aug 27 05:04:47 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:04:47 user nova-compute[72904]:       <mac address="fa:16:3e:00:94:30"/>
Aug 27 05:04:47 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:04:47 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:04:47 user nova-compute[72904]:       <target dev="tapa99493e7-a3"/>
Aug 27 05:04:47 user nova-compute[72904]:     </interface>
Aug 27 05:04:47 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:04:47 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/console.log" append="off"/>
Aug 27 05:04:47 user nova-compute[72904]:     </serial>
Aug 27 05:04:47 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:04:47 user nova-compute[72904]:     <video>
Aug 27 05:04:47 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:04:47 user nova-compute[72904]:     </video>
Aug 27 05:04:47 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:04:47 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:04:47 user nova-compute[72904]:     </rng>
Aug 27 05:04:47 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:04:47 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:04:47 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:04:47 user nova-compute[72904]:     </memballoon>
Aug 27 05:04:47 user nova-compute[72904]:   </devices>
Aug 27 05:04:47 user nova-compute[72904]: </domain>
Aug 27 05:04:47 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1383886142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1383886142',id=15,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-5pyri6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:04:45Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=4fba85dc-5514-4bc1-a731-1cd1af6da152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:94:30,bridge_name='br-int',has_traffic_filtering=True,id=a99493e7-a32a-4126-ba01-7563e74bb14d,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99493e7-a3') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG os_vif [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:94:30,bridge_name='br-int',has_traffic_filtering=True,id=a99493e7-a32a-4126-ba01-7563e74bb14d,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99493e7-a3') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa99493e7-a3, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa99493e7-a3, col_values=(('external_ids', {'iface-id': 'a99493e7-a32a-4126-ba01-7563e74bb14d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:94:30', 'vm-uuid': '4fba85dc-5514-4bc1-a731-1cd1af6da152'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:47 user nova-compute[72904]: INFO os_vif [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:94:30,bridge_name='br-int',has_traffic_filtering=True,id=a99493e7-a32a-4126-ba01-7563e74bb14d,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99493e7-a3')
Aug 27 05:04:47 user nova-compute[72904]: INFO nova.compute.manager [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Swapping old allocation on dict_keys(['5171e224-87c1-41ec-9fd6-f1643cc7adc6']) held by migration ed9e1e09-f8cf-4775-816c-a283848607bb for instance
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Overwriting current allocation {'allocations': {'5171e224-87c1-41ec-9fd6-f1643cc7adc6': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 19}}, 'project_id': '3e36dfaf419f4b78820a3536c6f65ad5', 'user_id': '58fce22ad00e47498c3cd80b3b6fe458', 'consumer_generation': 1} on consumer d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No VIF found with MAC fa:16:3e:00:94:30, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:04:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updated VIF entry in instance network info cache for port a99493e7-a32a-4126-ba01-7563e74bb14d. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updating instance_info_cache with network_info: [{"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79142c99-cdb4-40f6-8032-45bb2f2dcb67 req-5d1bc1ff-ce66-4f4f-a24e-2bfef734fc4e service nova] Releasing lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG os_brick.utils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb28a55-b88b-4ac7-90e1-ef60206412ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e85b3e1-7ba1-4eb6-ae45-d72f7f402c96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bf8007-3299-4f31-bdfe-a5544e47e6f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a2c02-829f-4aea-9f5e-bbd5564e0d7f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:04:48 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:04:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[11985feb-567e-4c6a-bec7-072fac116595]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:04:48 user nova-compute[72904]: DEBUG os_brick.utils [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-7435482c-b6f9-46a7-a283-81bc536f2c4b req-0852c0b3-3377-452a-985e-8154c04c07ce service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received event network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7435482c-b6f9-46a7-a283-81bc536f2c4b req-0852c0b3-3377-452a-985e-8154c04c07ce service nova] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7435482c-b6f9-46a7-a283-81bc536f2c4b req-0852c0b3-3377-452a-985e-8154c04c07ce service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7435482c-b6f9-46a7-a283-81bc536f2c4b req-0852c0b3-3377-452a-985e-8154c04c07ce service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-7435482c-b6f9-46a7-a283-81bc536f2c4b req-0852c0b3-3377-452a-985e-8154c04c07ce service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] No waiting events found dispatching network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:49 user nova-compute[72904]: WARNING nova.compute.manager [req-7435482c-b6f9-46a7-a283-81bc536f2c4b req-0852c0b3-3377-452a-985e-8154c04c07ce service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received unexpected event network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d for instance with vm_state building and task_state spawning.
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112676.3759773, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:51 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Stopped (Lifecycle Event)
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-647a6844-da0a-4a90-acd3-5b4605f01d1a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112691.5942452, 4fba85dc-5514-4bc1-a731-1cd1af6da152 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] VM Resumed (Lifecycle Event)
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:04:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Instance spawned successfully.
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:04:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112691.6037564, 4fba85dc-5514-4bc1-a731-1cd1af6da152 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:04:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] VM Started (Lifecycle Event)
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:04:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-83760a58-c247-453b-a623-c454a7e5e91c req-27d6721a-e50c-4d4a-8282-a552d6eb80f4 service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received event network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-83760a58-c247-453b-a623-c454a7e5e91c req-27d6721a-e50c-4d4a-8282-a552d6eb80f4 service nova] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-83760a58-c247-453b-a623-c454a7e5e91c req-27d6721a-e50c-4d4a-8282-a552d6eb80f4 service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-83760a58-c247-453b-a623-c454a7e5e91c req-27d6721a-e50c-4d4a-8282-a552d6eb80f4 service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-83760a58-c247-453b-a623-c454a7e5e91c req-27d6721a-e50c-4d4a-8282-a552d6eb80f4 service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] No waiting events found dispatching network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:04:51 user nova-compute[72904]: WARNING nova.compute.manager [req-83760a58-c247-453b-a623-c454a7e5e91c req-27d6721a-e50c-4d4a-8282-a552d6eb80f4 service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received unexpected event network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d for instance with vm_state building and task_state spawning.
Aug 27 05:04:51 user nova-compute[72904]: INFO nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 27 05:04:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:04:52 user nova-compute[72904]: INFO nova.compute.manager [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Took 7.65 seconds to build instance.
Aug 27 05:04:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-074acab7-6c65-460a-88e3-a0789ec27e32 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.771s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:04:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:04:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Starting finish_revert_migration {{(pid=72904) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Start _get_guest_xml network_info=[{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '331a5415-3241-43d2-a5e3-e2a45a846ba2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd57daa0e-5ce0-47cb-90f1-c4327bca54a0', 'attached_at': '2023-08-27T05:05:01.000000', 'detached_at': '', 'volume_id': 'b1f7d270-cd66-43e6-8000-a5fed172d681', 'serial': 'b1f7d270-cd66-43e6-8000-a5fed172d681'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:05:01 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:01 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lazy-loading 'vcpu_model' on Instance uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:05:01 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:05:01 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:05:01 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcc38a0-b73e-4d7a-997f-9551eef07848]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:05:01 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec3086-11a9-4d3c-befa-263b679070d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681] added
Aug 27 05:05:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74bbb3d-4dc0-4bc6-9e0a-aea7d9ab2c38]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3307b224-431e-468b-b11e-76158e5691ef]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQYhIgd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZwQYhIgd" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[69577663-ba93-42bf-af21-8c6d890c9121]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZwQYhIgd'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0425a7a-b75e-4033-94a9-f386c7c32682]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a2cd16-eb48-4278-8493-45690694e773]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:05:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:05:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:05:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6136969-e27a-449b-bc7d-9429cdcd241e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]
Aug 27 05:05:02 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.
Aug 27 05:05:02 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab0e3f0-98d7-486e-89ea-39820504eb13]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[776bb312-be41-410c-8470-c76209f1e5ec]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:05:02 user nova-compute[72904]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:05:02 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:05:02 user nova-compute[72904]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:05:02 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[90028c3c-b3d1-476d-8979-7ee66480c3d6]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26138366665646438', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138366665646438', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:03:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:05:03 user nova-compute[72904]:   <uuid>d57daa0e-5ce0-47cb-90f1-c4327bca54a0</uuid>
Aug 27 05:05:03 user nova-compute[72904]:   <name>instance-00000004</name>
Aug 27 05:05:03 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:05:03 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:05:03 user nova-compute[72904]:   <metadata>
Aug 27 05:05:03 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:05:03 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:05:03 user nova-compute[72904]:       <nova:name>tempest-ServerActionsTestOtherB-server-1845492887</nova:name>
Aug 27 05:05:03 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:05:01</nova:creationTime>
Aug 27 05:05:03 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:05:03 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:05:03 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:05:03 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:05:03 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:05:03 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:05:03 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:05:03 user nova-compute[72904]:       <nova:owner>
Aug 27 05:05:03 user nova-compute[72904]:         <nova:user uuid="58fce22ad00e47498c3cd80b3b6fe458">tempest-ServerActionsTestOtherB-30211083-project-member</nova:user>
Aug 27 05:05:03 user nova-compute[72904]:         <nova:project uuid="3e36dfaf419f4b78820a3536c6f65ad5">tempest-ServerActionsTestOtherB-30211083</nova:project>
Aug 27 05:05:03 user nova-compute[72904]:       </nova:owner>
Aug 27 05:05:03 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:05:03 user nova-compute[72904]:       <nova:ports>
Aug 27 05:05:03 user nova-compute[72904]:         <nova:port uuid="f4285663-09bc-421f-9017-4c18cf096612">
Aug 27 05:05:03 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 05:05:03 user nova-compute[72904]:         </nova:port>
Aug 27 05:05:03 user nova-compute[72904]:       </nova:ports>
Aug 27 05:05:03 user nova-compute[72904]:     </nova:instance>
Aug 27 05:05:03 user nova-compute[72904]:   </metadata>
Aug 27 05:05:03 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:05:03 user nova-compute[72904]:     <system>
Aug 27 05:05:03 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:05:03 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:05:03 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:05:03 user nova-compute[72904]:       <entry name="serial">d57daa0e-5ce0-47cb-90f1-c4327bca54a0</entry>
Aug 27 05:05:03 user nova-compute[72904]:       <entry name="uuid">d57daa0e-5ce0-47cb-90f1-c4327bca54a0</entry>
Aug 27 05:05:03 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:05:03 user nova-compute[72904]:     </system>
Aug 27 05:05:03 user nova-compute[72904]:   </sysinfo>
Aug 27 05:05:03 user nova-compute[72904]:   <os>
Aug 27 05:05:03 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:05:03 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:05:03 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:05:03 user nova-compute[72904]:   </os>
Aug 27 05:05:03 user nova-compute[72904]:   <features>
Aug 27 05:05:03 user nova-compute[72904]:     <acpi/>
Aug 27 05:05:03 user nova-compute[72904]:     <apic/>
Aug 27 05:05:03 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:05:03 user nova-compute[72904]:   </features>
Aug 27 05:05:03 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:05:03 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:05:03 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:05:03 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:05:03 user nova-compute[72904]:   </clock>
Aug 27 05:05:03 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:05:03 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:05:03 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:05:03 user nova-compute[72904]:   </cpu>
Aug 27 05:05:03 user nova-compute[72904]:   <devices>
Aug 27 05:05:03 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:05:03 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:05:03 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk"/>
Aug 27 05:05:03 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:05:03 user nova-compute[72904]:     </disk>
Aug 27 05:05:03 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:05:03 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:05:03 user nova-compute[72904]:       <source dev="/dev/sdc"/>
Aug 27 05:05:03 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:05:03 user nova-compute[72904]:       <serial>b1f7d270-cd66-43e6-8000-a5fed172d681</serial>
Aug 27 05:05:03 user nova-compute[72904]:     </disk>
Aug 27 05:05:03 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:05:03 user nova-compute[72904]:       <mac address="fa:16:3e:67:1b:45"/>
Aug 27 05:05:03 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:03 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:05:03 user nova-compute[72904]:       <target dev="tapf4285663-09"/>
Aug 27 05:05:03 user nova-compute[72904]:     </interface>
Aug 27 05:05:03 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:05:03 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/console.log" append="off"/>
Aug 27 05:05:03 user nova-compute[72904]:     </serial>
Aug 27 05:05:03 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:05:03 user nova-compute[72904]:     <video>
Aug 27 05:05:03 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:03 user nova-compute[72904]:     </video>
Aug 27 05:05:03 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:05:03 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:05:03 user nova-compute[72904]:     </rng>
Aug 27 05:05:03 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:05:03 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:05:03 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:05:03 user nova-compute[72904]:     </memballoon>
Aug 27 05:05:03 user nova-compute[72904]:   </devices>
Aug 27 05:05:03 user nova-compute[72904]: </domain>
Aug 27 05:05:03 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:03:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG os_vif [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4285663-09, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4285663-09, col_values=(('external_ids', {'iface-id': 'f4285663-09bc-421f-9017-4c18cf096612', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:1b:45', 'vm-uuid': 'd57daa0e-5ce0-47cb-90f1-c4327bca54a0'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:05:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:03 user nova-compute[72904]: INFO os_vif [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09')
Aug 27 05:05:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-f3b85889-37fb-4164-96e9-7ef9eb721b9b req-ad79cfb7-1c4f-4acc-af07-bbf825e3a5bd service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f3b85889-37fb-4164-96e9-7ef9eb721b9b req-ad79cfb7-1c4f-4acc-af07-bbf825e3a5bd service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f3b85889-37fb-4164-96e9-7ef9eb721b9b req-ad79cfb7-1c4f-4acc-af07-bbf825e3a5bd service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f3b85889-37fb-4164-96e9-7ef9eb721b9b req-ad79cfb7-1c4f-4acc-af07-bbf825e3a5bd service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-f3b85889-37fb-4164-96e9-7ef9eb721b9b req-ad79cfb7-1c4f-4acc-af07-bbf825e3a5bd service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:06 user nova-compute[72904]: WARNING nova.compute.manager [req-f3b85889-37fb-4164-96e9-7ef9eb721b9b req-ad79cfb7-1c4f-4acc-af07-bbf825e3a5bd service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state resized and task_state resize_reverting.
Aug 27 05:05:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:06 user nova-compute[72904]: INFO nova.compute.manager [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Detaching volume 4003285f-2c5d-4cda-82f6-d0e46fdc8672
Aug 27 05:05:06 user nova-compute[72904]: INFO nova.virt.block_device [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Attempting to driver detach volume 4003285f-2c5d-4cda-82f6-d0e46fdc8672 from mountpoint /dev/vdb
Aug 27 05:05:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Attempting to detach device vdb from instance cae1202f-0f6c-437e-8334-215b4736e061 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:05:06 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:05:06 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:05:06 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:05:06 user nova-compute[72904]:   <serial>4003285f-2c5d-4cda-82f6-d0e46fdc8672</serial>
Aug 27 05:05:06 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:05:06 user nova-compute[72904]: </disk>
Aug 27 05:05:06 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:05:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Successfully detached device vdb from instance cae1202f-0f6c-437e-8334-215b4736e061 from the persistent domain config.
Aug 27 05:05:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cae1202f-0f6c-437e-8334-215b4736e061 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:05:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:05:06 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:05:06 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:05:06 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:05:06 user nova-compute[72904]:   <serial>4003285f-2c5d-4cda-82f6-d0e46fdc8672</serial>
Aug 27 05:05:06 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:05:06 user nova-compute[72904]: </disk>
Aug 27 05:05:06 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693112707.5669222, cae1202f-0f6c-437e-8334-215b4736e061 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:05:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Successfully detached device vdb from instance cae1202f-0f6c-437e-8334-215b4736e061 from the live domain config.
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGyslYBb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:05:07 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7651ce-37ca-453d-a3ed-93f0d46f0d80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccee8f6-110f-428a-9c49-0a0f527aab89]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:05:07 user nova-compute[72904]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:05:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 (non-flash)
Aug 27 05:05:07 user nova-compute[72904]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:05:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c685900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78d820b-322a-4f5d-8588-9a13dd9aeed8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[996acad5-4b9d-4698-b36c-23bf65dd0214]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb01c345-6e31-4d5a-8053-42ee252e6823]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbf2ecf-2d29-4299-971d-cffaf937ea82]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4863f4-b4be-4c0d-9720-63dc509c0711]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112707.8703446, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Resumed (Lifecycle Event)
Aug 27 05:05:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance running successfully.
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] finish_revert_migration finished successfully. {{(pid=72904) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea27616-df4b-43ec-804e-d0d1258fd015]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260]
Aug 27 05:05:07 user nova-compute[72904]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672, portal: 172.16.0.220,3260] successful.
Aug 27 05:05:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003285f-2c5d-4cda-82f6-d0e46fdc8672 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47934a3-609c-47b5-a740-f3d2c1e82dee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] <== disconnect_volume: return (371ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:05:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 05:05:07 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112707.8706994, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Started (Lifecycle Event)
Aug 27 05:05:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 27 05:05:08 user nova-compute[72904]: INFO nova.compute.manager [None req-3c8f7cd0-32f5-43ed-9098-4adf960e9a1e tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance to original state: 'active'
Aug 27 05:05:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-5fa123c9-1795-4c22-b194-86d9b28bbe69 req-c62c8bba-dcfb-4873-8265-538b384b06f1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fa123c9-1795-4c22-b194-86d9b28bbe69 req-c62c8bba-dcfb-4873-8265-538b384b06f1 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fa123c9-1795-4c22-b194-86d9b28bbe69 req-c62c8bba-dcfb-4873-8265-538b384b06f1 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fa123c9-1795-4c22-b194-86d9b28bbe69 req-c62c8bba-dcfb-4873-8265-538b384b06f1 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-5fa123c9-1795-4c22-b194-86d9b28bbe69 req-c62c8bba-dcfb-4873-8265-538b384b06f1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:08 user nova-compute[72904]: WARNING nova.compute.manager [req-5fa123c9-1795-4c22-b194-86d9b28bbe69 req-c62c8bba-dcfb-4873-8265-538b384b06f1 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state resized and task_state resize_reverting.
Aug 27 05:05:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:05:08 user nova-compute[72904]: INFO nova.compute.claims [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Claim successful on node user
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:05:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.policy [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223d760d5f03408781a9241f98a5a6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16eb565e64463c9a6e61ddcad25728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:05:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Creating image(s)
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.226s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk 1073741824" returned: 0 in 0.071s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:05:10 user nova-compute[72904]: INFO nova.compute.claims [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Claim successful on node user
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.237s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Cannot resize image /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Ensure instance console log exists: /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Successfully created port: 9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:05:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:05:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Creating image(s)
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.034s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG nova.policy [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223d760d5f03408781a9241f98a5a6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16eb565e64463c9a6e61ddcad25728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:05:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.223s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.259s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk 1073741824" returned: 0 in 0.076s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.225s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Cannot resize image /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Ensure instance console log exists: /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Successfully created port: 14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Successfully updated port: 9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-changed-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Refreshing instance network info cache due to event network-changed-9d900a0d-2639-401f-90f9-de3ad2392683. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] Acquiring lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:05:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.neutron [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance network_info: |[{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] Acquired lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.neutron [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Refreshing network info cache for port 9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Start _get_guest_xml network_info=[{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:05:13 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:13 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929196508',display_name='tempest-ServerRescueNegativeTestJSON-server-1929196508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929196508',id=16,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-gd8c0sey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:09Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=19a548f0-90c2-47bb-8a68-7a788d7d736b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.objects.instance [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'pci_devices' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:05:13 user nova-compute[72904]:   <uuid>19a548f0-90c2-47bb-8a68-7a788d7d736b</uuid>
Aug 27 05:05:13 user nova-compute[72904]:   <name>instance-00000010</name>
Aug 27 05:05:13 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:05:13 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:05:13 user nova-compute[72904]:   <metadata>
Aug 27 05:05:13 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:05:13 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:05:13 user nova-compute[72904]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1929196508</nova:name>
Aug 27 05:05:13 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:05:13</nova:creationTime>
Aug 27 05:05:13 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:05:13 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:05:13 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:05:13 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:05:13 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:05:13 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:05:13 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:05:13 user nova-compute[72904]:       <nova:owner>
Aug 27 05:05:13 user nova-compute[72904]:         <nova:user uuid="223d760d5f03408781a9241f98a5a6c8">tempest-ServerRescueNegativeTestJSON-275121126-project-member</nova:user>
Aug 27 05:05:13 user nova-compute[72904]:         <nova:project uuid="1b16eb565e64463c9a6e61ddcad25728">tempest-ServerRescueNegativeTestJSON-275121126</nova:project>
Aug 27 05:05:13 user nova-compute[72904]:       </nova:owner>
Aug 27 05:05:13 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:05:13 user nova-compute[72904]:       <nova:ports>
Aug 27 05:05:13 user nova-compute[72904]:         <nova:port uuid="9d900a0d-2639-401f-90f9-de3ad2392683">
Aug 27 05:05:13 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 05:05:13 user nova-compute[72904]:         </nova:port>
Aug 27 05:05:13 user nova-compute[72904]:       </nova:ports>
Aug 27 05:05:13 user nova-compute[72904]:     </nova:instance>
Aug 27 05:05:13 user nova-compute[72904]:   </metadata>
Aug 27 05:05:13 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:05:13 user nova-compute[72904]:     <system>
Aug 27 05:05:13 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:05:13 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:05:13 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:05:13 user nova-compute[72904]:       <entry name="serial">19a548f0-90c2-47bb-8a68-7a788d7d736b</entry>
Aug 27 05:05:13 user nova-compute[72904]:       <entry name="uuid">19a548f0-90c2-47bb-8a68-7a788d7d736b</entry>
Aug 27 05:05:13 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:05:13 user nova-compute[72904]:     </system>
Aug 27 05:05:13 user nova-compute[72904]:   </sysinfo>
Aug 27 05:05:13 user nova-compute[72904]:   <os>
Aug 27 05:05:13 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:05:13 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:05:13 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:05:13 user nova-compute[72904]:   </os>
Aug 27 05:05:13 user nova-compute[72904]:   <features>
Aug 27 05:05:13 user nova-compute[72904]:     <acpi/>
Aug 27 05:05:13 user nova-compute[72904]:     <apic/>
Aug 27 05:05:13 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:05:13 user nova-compute[72904]:   </features>
Aug 27 05:05:13 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:05:13 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:05:13 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:05:13 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:05:13 user nova-compute[72904]:   </clock>
Aug 27 05:05:13 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:05:13 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:05:13 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:05:13 user nova-compute[72904]:   </cpu>
Aug 27 05:05:13 user nova-compute[72904]:   <devices>
Aug 27 05:05:13 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:05:13 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:05:13 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk"/>
Aug 27 05:05:13 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:05:13 user nova-compute[72904]:     </disk>
Aug 27 05:05:13 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:05:13 user nova-compute[72904]:       <mac address="fa:16:3e:92:42:3e"/>
Aug 27 05:05:13 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:13 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:05:13 user nova-compute[72904]:       <target dev="tap9d900a0d-26"/>
Aug 27 05:05:13 user nova-compute[72904]:     </interface>
Aug 27 05:05:13 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:05:13 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/console.log" append="off"/>
Aug 27 05:05:13 user nova-compute[72904]:     </serial>
Aug 27 05:05:13 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:05:13 user nova-compute[72904]:     <video>
Aug 27 05:05:13 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:13 user nova-compute[72904]:     </video>
Aug 27 05:05:13 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:05:13 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:05:13 user nova-compute[72904]:     </rng>
Aug 27 05:05:13 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:05:13 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:05:13 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:05:13 user nova-compute[72904]:     </memballoon>
Aug 27 05:05:13 user nova-compute[72904]:   </devices>
Aug 27 05:05:13 user nova-compute[72904]: </domain>
Aug 27 05:05:13 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929196508',display_name='tempest-ServerRescueNegativeTestJSON-server-1929196508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929196508',id=16,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-gd8c0sey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:09Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=19a548f0-90c2-47bb-8a68-7a788d7d736b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG os_vif [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d900a0d-26, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d900a0d-26, col_values=(('external_ids', {'iface-id': '9d900a0d-2639-401f-90f9-de3ad2392683', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:42:3e', 'vm-uuid': '19a548f0-90c2-47bb-8a68-7a788d7d736b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:13 user nova-compute[72904]: INFO os_vif [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26')
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No VIF found with MAC fa:16:3e:92:42:3e, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Successfully updated port: 14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.neutron [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updated VIF entry in instance network info cache for port 9d900a0d-2639-401f-90f9-de3ad2392683. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG nova.network.neutron [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a3acd60a-1039-4b85-9bbd-d4341b155084 req-e664c09e-6796-451c-8f79-32266e6d973f service nova] Releasing lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance network_info: |[{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Start _get_guest_xml network_info=[{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:05:14 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:14 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871237085',display_name='tempest-ServerRescueNegativeTestJSON-server-871237085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871237085',id=17,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-wakr8260',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:11Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=d0a4c5ee-08b1-49a8-9a9d-135e9db9237b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.objects.instance [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'pci_devices' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:05:14 user nova-compute[72904]:   <uuid>d0a4c5ee-08b1-49a8-9a9d-135e9db9237b</uuid>
Aug 27 05:05:14 user nova-compute[72904]:   <name>instance-00000011</name>
Aug 27 05:05:14 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:05:14 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:05:14 user nova-compute[72904]:   <metadata>
Aug 27 05:05:14 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:05:14 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:05:14 user nova-compute[72904]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-871237085</nova:name>
Aug 27 05:05:14 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:05:14</nova:creationTime>
Aug 27 05:05:14 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:05:14 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:05:14 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:05:14 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:05:14 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:05:14 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:05:14 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:05:14 user nova-compute[72904]:       <nova:owner>
Aug 27 05:05:14 user nova-compute[72904]:         <nova:user uuid="223d760d5f03408781a9241f98a5a6c8">tempest-ServerRescueNegativeTestJSON-275121126-project-member</nova:user>
Aug 27 05:05:14 user nova-compute[72904]:         <nova:project uuid="1b16eb565e64463c9a6e61ddcad25728">tempest-ServerRescueNegativeTestJSON-275121126</nova:project>
Aug 27 05:05:14 user nova-compute[72904]:       </nova:owner>
Aug 27 05:05:14 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:05:14 user nova-compute[72904]:       <nova:ports>
Aug 27 05:05:14 user nova-compute[72904]:         <nova:port uuid="14c794cb-b91e-44a9-ab04-1f5e9c51042b">
Aug 27 05:05:14 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:05:14 user nova-compute[72904]:         </nova:port>
Aug 27 05:05:14 user nova-compute[72904]:       </nova:ports>
Aug 27 05:05:14 user nova-compute[72904]:     </nova:instance>
Aug 27 05:05:14 user nova-compute[72904]:   </metadata>
Aug 27 05:05:14 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:05:14 user nova-compute[72904]:     <system>
Aug 27 05:05:14 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:05:14 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:05:14 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:05:14 user nova-compute[72904]:       <entry name="serial">d0a4c5ee-08b1-49a8-9a9d-135e9db9237b</entry>
Aug 27 05:05:14 user nova-compute[72904]:       <entry name="uuid">d0a4c5ee-08b1-49a8-9a9d-135e9db9237b</entry>
Aug 27 05:05:14 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:05:14 user nova-compute[72904]:     </system>
Aug 27 05:05:14 user nova-compute[72904]:   </sysinfo>
Aug 27 05:05:14 user nova-compute[72904]:   <os>
Aug 27 05:05:14 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:05:14 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:05:14 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:05:14 user nova-compute[72904]:   </os>
Aug 27 05:05:14 user nova-compute[72904]:   <features>
Aug 27 05:05:14 user nova-compute[72904]:     <acpi/>
Aug 27 05:05:14 user nova-compute[72904]:     <apic/>
Aug 27 05:05:14 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:05:14 user nova-compute[72904]:   </features>
Aug 27 05:05:14 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:05:14 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:05:14 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:05:14 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:05:14 user nova-compute[72904]:   </clock>
Aug 27 05:05:14 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:05:14 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:05:14 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:05:14 user nova-compute[72904]:   </cpu>
Aug 27 05:05:14 user nova-compute[72904]:   <devices>
Aug 27 05:05:14 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:05:14 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:05:14 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk"/>
Aug 27 05:05:14 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:05:14 user nova-compute[72904]:     </disk>
Aug 27 05:05:14 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:05:14 user nova-compute[72904]:       <mac address="fa:16:3e:83:01:a7"/>
Aug 27 05:05:14 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:14 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:05:14 user nova-compute[72904]:       <target dev="tap14c794cb-b9"/>
Aug 27 05:05:14 user nova-compute[72904]:     </interface>
Aug 27 05:05:14 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:05:14 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/console.log" append="off"/>
Aug 27 05:05:14 user nova-compute[72904]:     </serial>
Aug 27 05:05:14 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:05:14 user nova-compute[72904]:     <video>
Aug 27 05:05:14 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:14 user nova-compute[72904]:     </video>
Aug 27 05:05:14 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:05:14 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:05:14 user nova-compute[72904]:     </rng>
Aug 27 05:05:14 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:05:14 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:05:14 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:05:14 user nova-compute[72904]:     </memballoon>
Aug 27 05:05:14 user nova-compute[72904]:   </devices>
Aug 27 05:05:14 user nova-compute[72904]: </domain>
Aug 27 05:05:14 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871237085',display_name='tempest-ServerRescueNegativeTestJSON-server-871237085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871237085',id=17,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-wakr8260',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:11Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=d0a4c5ee-08b1-49a8-9a9d-135e9db9237b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG os_vif [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14c794cb-b9, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14c794cb-b9, col_values=(('external_ids', {'iface-id': '14c794cb-b91e-44a9-ab04-1f5e9c51042b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:01:a7', 'vm-uuid': 'd0a4c5ee-08b1-49a8-9a9d-135e9db9237b'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:14 user nova-compute[72904]: INFO os_vif [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9')
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-changed-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Refreshing instance network info cache due to event network-changed-14c794cb-b91e-44a9-ab04-1f5e9c51042b. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] Acquiring lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] Acquired lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.network.neutron [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Refreshing network info cache for port 14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No VIF found with MAC fa:16:3e:83:01:a7, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:05:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updated VIF entry in instance network info cache for port 14c794cb-b91e-44a9-ab04-1f5e9c51042b. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b2d8550a-8bfb-4282-a8cd-78c5e0a97628 req-2fa21f7f-0817-409d-9c0c-6d93144cd40d service nova] Releasing lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:16 user nova-compute[72904]: WARNING nova.compute.manager [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state building and task_state spawning.
Aug 27 05:05:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:16 user nova-compute[72904]: WARNING nova.compute.manager [req-6bd1a507-5089-47cf-879f-91c9ca9761c2 req-c632509b-70f0-4a92-9c0d-e8baaced9a44 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state building and task_state spawning.
Aug 27 05:05:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b2742f3-914a-4ace-a650-009cb9b3a341 req-22227ead-5b32-446d-9684-2bee7b47c3be service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b2742f3-914a-4ace-a650-009cb9b3a341 req-22227ead-5b32-446d-9684-2bee7b47c3be service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b2742f3-914a-4ace-a650-009cb9b3a341 req-22227ead-5b32-446d-9684-2bee7b47c3be service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b2742f3-914a-4ace-a650-009cb9b3a341 req-22227ead-5b32-446d-9684-2bee7b47c3be service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b2742f3-914a-4ace-a650-009cb9b3a341 req-22227ead-5b32-446d-9684-2bee7b47c3be service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:17 user nova-compute[72904]: WARNING nova.compute.manager [req-6b2742f3-914a-4ace-a650-009cb9b3a341 req-22227ead-5b32-446d-9684-2bee7b47c3be service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state building and task_state spawning.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112719.103495, d0a4c5ee-08b1-49a8-9a9d-135e9db9237b => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] VM Resumed (Lifecycle Event)
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance spawned successfully.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance spawned successfully.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112719.107957, d0a4c5ee-08b1-49a8-9a9d-135e9db9237b => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] VM Started (Lifecycle Event)
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-fc5f57a4-abfd-4c7e-84e4-739d8b47f6ab req-472baa1e-bee2-4aeb-b61b-21b17dff5e09 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fc5f57a4-abfd-4c7e-84e4-739d8b47f6ab req-472baa1e-bee2-4aeb-b61b-21b17dff5e09 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fc5f57a4-abfd-4c7e-84e4-739d8b47f6ab req-472baa1e-bee2-4aeb-b61b-21b17dff5e09 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fc5f57a4-abfd-4c7e-84e4-739d8b47f6ab req-472baa1e-bee2-4aeb-b61b-21b17dff5e09 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-fc5f57a4-abfd-4c7e-84e4-739d8b47f6ab req-472baa1e-bee2-4aeb-b61b-21b17dff5e09 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:19 user nova-compute[72904]: WARNING nova.compute.manager [req-fc5f57a4-abfd-4c7e-84e4-739d8b47f6ab req-472baa1e-bee2-4aeb-b61b-21b17dff5e09 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state building and task_state spawning.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Took 9.93 seconds to spawn the instance on the hypervisor.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112719.1093848, 19a548f0-90c2-47bb-8a68-7a788d7d736b => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] VM Resumed (Lifecycle Event)
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Took 8.68 seconds to spawn the instance on the hypervisor.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112719.113289, 19a548f0-90c2-47bb-8a68-7a788d7d736b => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] VM Started (Lifecycle Event)
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Took 10.96 seconds to build instance.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-acffe1ae-2f90-4d98-bb9d-072afb174edd tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.104s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:19 user nova-compute[72904]: INFO nova.compute.manager [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Took 9.74 seconds to build instance.
Aug 27 05:05:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0617df7d-9b85-400d-8318-a0b4ce722512 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.938s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:20 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:05:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:22 user nova-compute[72904]: INFO nova.compute.manager [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Terminating instance
Aug 27 05:05:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:05:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.objects.instance [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'flavor' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-46a0ddee-cd75-452f-b63f-fb1a6057e3e6 tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 16.685s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-d9605944-63e5-41cc-81e8-af6760b36a42 req-3c633935-aa54-4715-a59f-01edd8c22d5f service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-vif-unplugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d9605944-63e5-41cc-81e8-af6760b36a42 req-3c633935-aa54-4715-a59f-01edd8c22d5f service nova] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d9605944-63e5-41cc-81e8-af6760b36a42 req-3c633935-aa54-4715-a59f-01edd8c22d5f service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d9605944-63e5-41cc-81e8-af6760b36a42 req-3c633935-aa54-4715-a59f-01edd8c22d5f service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-d9605944-63e5-41cc-81e8-af6760b36a42 req-3c633935-aa54-4715-a59f-01edd8c22d5f service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] No waiting events found dispatching network-vif-unplugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-d9605944-63e5-41cc-81e8-af6760b36a42 req-3c633935-aa54-4715-a59f-01edd8c22d5f service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-vif-unplugged-99601399-a7c6-4528-8750-14287da7d02d for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Instance destroyed successfully.
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lazy-loading 'resources' on Instance uuid 660b1c77-120e-40d5-b698-b89ec506caf3 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1065481276',display_name='tempest-VolumesAdminNegativeTest-server-1065481276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1065481276',id=6,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBID1Cqes+vdZxYwuqVZebrL1J1HljqFqVd2LKgJcFiJhbLMtyTH1+MfNjFD6SXcST83Hu9Jffm6U//qndSB4v6MHzlgqpLDV5h8+1ev12oxzlaIM//q0xGMAvP43D5PeEg==',key_name='tempest-keypair-372493157',keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:59:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97d22ddf3716486784e9bc8d39420d63',ramdisk_id='',reservation_id='r-uk23fs4e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1562447872',owner_user_name='tempest-VolumesAdminNegativeTest-1562447872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3aa245527faf42099b0bcefbad8e9a13',uuid=660b1c77-120e-40d5-b698-b89ec506caf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converting VIF {"id": "99601399-a7c6-4528-8750-14287da7d02d", "address": "fa:16:3e:65:a9:5f", "network": {"id": "6c482ee3-615a-46ca-93c4-51bd7919d41e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2022433999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97d22ddf3716486784e9bc8d39420d63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99601399-a7", "ovs_interfaceid": "99601399-a7c6-4528-8750-14287da7d02d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:a9:5f,bridge_name='br-int',has_traffic_filtering=True,id=99601399-a7c6-4528-8750-14287da7d02d,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99601399-a7') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG os_vif [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:a9:5f,bridge_name='br-int',has_traffic_filtering=True,id=99601399-a7c6-4528-8750-14287da7d02d,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99601399-a7') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99601399-a7, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:05:24 user nova-compute[72904]: INFO os_vif [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:a9:5f,bridge_name='br-int',has_traffic_filtering=True,id=99601399-a7c6-4528-8750-14287da7d02d,network=Network(6c482ee3-615a-46ca-93c4-51bd7919d41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99601399-a7')
Aug 27 05:05:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Deleting instance files /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3_del
Aug 27 05:05:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Deletion of /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3_del complete
Aug 27 05:05:24 user nova-compute[72904]: INFO nova.compute.manager [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json" returned: 1 in 0.261s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk --force-share --output=json' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:05:24 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000006, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/660b1c77-120e-40d5-b698-b89ec506caf3/disk
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-91f4c3ba-b42b-4923-ac5b-4e03193f18ab req-9e03bc16-caf1-4db4-8c13-372bb5a6de08 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-91f4c3ba-b42b-4923-ac5b-4e03193f18ab req-9e03bc16-caf1-4db4-8c13-372bb5a6de08 service nova] Acquiring lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-91f4c3ba-b42b-4923-ac5b-4e03193f18ab req-9e03bc16-caf1-4db4-8c13-372bb5a6de08 service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-91f4c3ba-b42b-4923-ac5b-4e03193f18ab req-9e03bc16-caf1-4db4-8c13-372bb5a6de08 service nova] Lock "660b1c77-120e-40d5-b698-b89ec506caf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-91f4c3ba-b42b-4923-ac5b-4e03193f18ab req-9e03bc16-caf1-4db4-8c13-372bb5a6de08 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] No waiting events found dispatching network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:25 user nova-compute[72904]: WARNING nova.compute.manager [req-91f4c3ba-b42b-4923-ac5b-4e03193f18ab req-9e03bc16-caf1-4db4-8c13-372bb5a6de08 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received unexpected event network-vif-plugged-99601399-a7c6-4528-8750-14287da7d02d for instance with vm_state active and task_state deleting.
Aug 27 05:05:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:25 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7513MB free_disk=25.688316345214844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance cae1202f-0f6c-437e-8334-215b4736e061 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 660b1c77-120e-40d5-b698-b89ec506caf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:26 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Took 2.48 seconds to deallocate network for instance.
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-443cfd46-67d8-493a-801e-c22d48788fa5 req-044693b9-5fc5-4ba2-a607-56a95fb144c4 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Received event network-vif-deleted-99601399-a7c6-4528-8750-14287da7d02d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:26 user nova-compute[72904]: INFO nova.compute.manager [req-443cfd46-67d8-493a-801e-c22d48788fa5 req-044693b9-5fc5-4ba2-a607-56a95fb144c4 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Neutron deleted interface 99601399-a7c6-4528-8750-14287da7d02d; detaching it from the instance and deleting it from the info cache
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-443cfd46-67d8-493a-801e-c22d48788fa5 req-044693b9-5fc5-4ba2-a607-56a95fb144c4 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-443cfd46-67d8-493a-801e-c22d48788fa5 req-044693b9-5fc5-4ba2-a607-56a95fb144c4 service nova] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Detach interface failed, port_id=99601399-a7c6-4528-8750-14287da7d02d, reason: Instance 660b1c77-120e-40d5-b698-b89ec506caf3 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:05:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:27 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Deleted allocations for instance 660b1c77-120e-40d5-b698-b89ec506caf3
Aug 27 05:05:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d618ede8-290b-4763-8d59-80074b2f6181 tempest-VolumesAdminNegativeTest-1562447872 tempest-VolumesAdminNegativeTest-1562447872-project-member] Lock "660b1c77-120e-40d5-b698-b89ec506caf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.217s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid 9ca0a7be-bc37-473c-8523-4808a76a1b5d {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updating instance_info_cache with network_info: [{"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-9ca0a7be-bc37-473c-8523-4808a76a1b5d" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:05:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:05:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:05:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:34 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:05:34 user nova-compute[72904]: INFO nova.compute.claims [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Claim successful on node user
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.703s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:05:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.policy [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a96642953830474a968fbb0a4e21aaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a21df639749929efe405de33b9718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:05:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Creating image(s)
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "/opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "/opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk 1073741824" returned: 0 in 0.069s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Successfully created port: e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.213s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Cannot resize image /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Ensure instance console log exists: /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Successfully updated port: e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "refresh_cache-d6410a72-6124-440e-a891-3f0dfc2aa2d9" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquired lock "refresh_cache-d6410a72-6124-440e-a891-3f0dfc2aa2d9" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received event network-changed-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Refreshing instance network info cache due to event network-changed-e7e63889-5fd1-4cd6-b390-c875c6ef5bde. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] Acquiring lock "refresh_cache-d6410a72-6124-440e-a891-3f0dfc2aa2d9" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Updating instance_info_cache with network_info: [{"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Releasing lock "refresh_cache-d6410a72-6124-440e-a891-3f0dfc2aa2d9" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Instance network_info: |[{"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] Acquired lock "refresh_cache-d6410a72-6124-440e-a891-3f0dfc2aa2d9" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Refreshing network info cache for port e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Start _get_guest_xml network_info=[{"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:05:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-427078684',display_name='tempest-VolumesActionsTest-instance-427078684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-427078684',id=18,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d44a21df639749929efe405de33b9718',ramdisk_id='',reservation_id='r-r0474yxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1180339496',owner_user_name='tempest-VolumesActionsTest-1180339496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:35Z,user_data=None,user_id='a96642953830474a968fbb0a4e21aaaf',uuid=d6410a72-6124-440e-a891-3f0dfc2aa2d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converting VIF {"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e8:3c,bridge_name='br-int',has_traffic_filtering=True,id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e63889-5f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lazy-loading 'pci_devices' on Instance uuid d6410a72-6124-440e-a891-3f0dfc2aa2d9 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:05:37 user nova-compute[72904]:   <uuid>d6410a72-6124-440e-a891-3f0dfc2aa2d9</uuid>
Aug 27 05:05:37 user nova-compute[72904]:   <name>instance-00000012</name>
Aug 27 05:05:37 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:05:37 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:05:37 user nova-compute[72904]:   <metadata>
Aug 27 05:05:37 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:05:37 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:05:37 user nova-compute[72904]:       <nova:name>tempest-VolumesActionsTest-instance-427078684</nova:name>
Aug 27 05:05:37 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:05:37</nova:creationTime>
Aug 27 05:05:37 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:05:37 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:05:37 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:05:37 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:05:37 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:05:37 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:05:37 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:05:37 user nova-compute[72904]:       <nova:owner>
Aug 27 05:05:37 user nova-compute[72904]:         <nova:user uuid="a96642953830474a968fbb0a4e21aaaf">tempest-VolumesActionsTest-1180339496-project-member</nova:user>
Aug 27 05:05:37 user nova-compute[72904]:         <nova:project uuid="d44a21df639749929efe405de33b9718">tempest-VolumesActionsTest-1180339496</nova:project>
Aug 27 05:05:37 user nova-compute[72904]:       </nova:owner>
Aug 27 05:05:37 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:05:37 user nova-compute[72904]:       <nova:ports>
Aug 27 05:05:37 user nova-compute[72904]:         <nova:port uuid="e7e63889-5fd1-4cd6-b390-c875c6ef5bde">
Aug 27 05:05:37 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:05:37 user nova-compute[72904]:         </nova:port>
Aug 27 05:05:37 user nova-compute[72904]:       </nova:ports>
Aug 27 05:05:37 user nova-compute[72904]:     </nova:instance>
Aug 27 05:05:37 user nova-compute[72904]:   </metadata>
Aug 27 05:05:37 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:05:37 user nova-compute[72904]:     <system>
Aug 27 05:05:37 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:05:37 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:05:37 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:05:37 user nova-compute[72904]:       <entry name="serial">d6410a72-6124-440e-a891-3f0dfc2aa2d9</entry>
Aug 27 05:05:37 user nova-compute[72904]:       <entry name="uuid">d6410a72-6124-440e-a891-3f0dfc2aa2d9</entry>
Aug 27 05:05:37 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:05:37 user nova-compute[72904]:     </system>
Aug 27 05:05:37 user nova-compute[72904]:   </sysinfo>
Aug 27 05:05:37 user nova-compute[72904]:   <os>
Aug 27 05:05:37 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:05:37 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:05:37 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:05:37 user nova-compute[72904]:   </os>
Aug 27 05:05:37 user nova-compute[72904]:   <features>
Aug 27 05:05:37 user nova-compute[72904]:     <acpi/>
Aug 27 05:05:37 user nova-compute[72904]:     <apic/>
Aug 27 05:05:37 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:05:37 user nova-compute[72904]:   </features>
Aug 27 05:05:37 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:05:37 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:05:37 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:05:37 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:05:37 user nova-compute[72904]:   </clock>
Aug 27 05:05:37 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:05:37 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:05:37 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:05:37 user nova-compute[72904]:   </cpu>
Aug 27 05:05:37 user nova-compute[72904]:   <devices>
Aug 27 05:05:37 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:05:37 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:05:37 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk"/>
Aug 27 05:05:37 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:05:37 user nova-compute[72904]:     </disk>
Aug 27 05:05:37 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:05:37 user nova-compute[72904]:       <mac address="fa:16:3e:ff:e8:3c"/>
Aug 27 05:05:37 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:37 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:05:37 user nova-compute[72904]:       <target dev="tape7e63889-5f"/>
Aug 27 05:05:37 user nova-compute[72904]:     </interface>
Aug 27 05:05:37 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:05:37 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/console.log" append="off"/>
Aug 27 05:05:37 user nova-compute[72904]:     </serial>
Aug 27 05:05:37 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:05:37 user nova-compute[72904]:     <video>
Aug 27 05:05:37 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:05:37 user nova-compute[72904]:     </video>
Aug 27 05:05:37 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:05:37 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:05:37 user nova-compute[72904]:     </rng>
Aug 27 05:05:37 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:05:37 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:05:37 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:05:37 user nova-compute[72904]:     </memballoon>
Aug 27 05:05:37 user nova-compute[72904]:   </devices>
Aug 27 05:05:37 user nova-compute[72904]: </domain>
Aug 27 05:05:37 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-427078684',display_name='tempest-VolumesActionsTest-instance-427078684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-427078684',id=18,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d44a21df639749929efe405de33b9718',ramdisk_id='',reservation_id='r-r0474yxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1180339496',owner_user_name='tempest-VolumesActionsTest-1180339496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:35Z,user_data=None,user_id='a96642953830474a968fbb0a4e21aaaf',uuid=d6410a72-6124-440e-a891-3f0dfc2aa2d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converting VIF {"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e8:3c,bridge_name='br-int',has_traffic_filtering=True,id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e63889-5f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG os_vif [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e8:3c,bridge_name='br-int',has_traffic_filtering=True,id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e63889-5f') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7e63889-5f, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7e63889-5f, col_values=(('external_ids', {'iface-id': 'e7e63889-5fd1-4cd6-b390-c875c6ef5bde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:e8:3c', 'vm-uuid': 'd6410a72-6124-440e-a891-3f0dfc2aa2d9'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:38 user nova-compute[72904]: INFO os_vif [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e8:3c,bridge_name='br-int',has_traffic_filtering=True,id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e63889-5f')
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] No VIF found with MAC fa:16:3e:ff:e8:3c, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Updated VIF entry in instance network info cache for port e7e63889-5fd1-4cd6-b390-c875c6ef5bde. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Updating instance_info_cache with network_info: [{"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4577d644-30ae-4b48-9444-2642a97af632 req-61faa63c-1e73-4dd7-b39b-3d3cfdf34563 service nova] Releasing lock "refresh_cache-d6410a72-6124-440e-a891-3f0dfc2aa2d9" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112723.8656285, 660b1c77-120e-40d5-b698-b89ec506caf3 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:38 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] VM Stopped (Lifecycle Event)
Aug 27 05:05:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f0883be2-f91a-4434-a750-958f40d8ba44 None None] [instance: 660b1c77-120e-40d5-b698-b89ec506caf3] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-00053d50-3e5c-4e7e-9250-e23789478376 req-2d4ccd91-2646-46ee-a7f2-c9f4c2b1f2e1 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received event network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-00053d50-3e5c-4e7e-9250-e23789478376 req-2d4ccd91-2646-46ee-a7f2-c9f4c2b1f2e1 service nova] Acquiring lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-00053d50-3e5c-4e7e-9250-e23789478376 req-2d4ccd91-2646-46ee-a7f2-c9f4c2b1f2e1 service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-00053d50-3e5c-4e7e-9250-e23789478376 req-2d4ccd91-2646-46ee-a7f2-c9f4c2b1f2e1 service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-00053d50-3e5c-4e7e-9250-e23789478376 req-2d4ccd91-2646-46ee-a7f2-c9f4c2b1f2e1 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] No waiting events found dispatching network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:39 user nova-compute[72904]: WARNING nova.compute.manager [req-00053d50-3e5c-4e7e-9250-e23789478376 req-2d4ccd91-2646-46ee-a7f2-c9f4c2b1f2e1 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received unexpected event network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde for instance with vm_state building and task_state spawning.
Aug 27 05:05:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-6376a083-2f3f-4a50-bf4a-4a61676c72d6 req-5da91f97-e184-4ccd-8754-1feea83f9752 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received event network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6376a083-2f3f-4a50-bf4a-4a61676c72d6 req-5da91f97-e184-4ccd-8754-1feea83f9752 service nova] Acquiring lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6376a083-2f3f-4a50-bf4a-4a61676c72d6 req-5da91f97-e184-4ccd-8754-1feea83f9752 service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6376a083-2f3f-4a50-bf4a-4a61676c72d6 req-5da91f97-e184-4ccd-8754-1feea83f9752 service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-6376a083-2f3f-4a50-bf4a-4a61676c72d6 req-5da91f97-e184-4ccd-8754-1feea83f9752 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] No waiting events found dispatching network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:41 user nova-compute[72904]: WARNING nova.compute.manager [req-6376a083-2f3f-4a50-bf4a-4a61676c72d6 req-5da91f97-e184-4ccd-8754-1feea83f9752 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received unexpected event network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde for instance with vm_state building and task_state spawning.
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112742.0953152, d6410a72-6124-440e-a891-3f0dfc2aa2d9 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:42 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] VM Resumed (Lifecycle Event)
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:05:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Instance spawned successfully.
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:05:42 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112742.1008096, d6410a72-6124-440e-a891-3f0dfc2aa2d9 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:05:42 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] VM Started (Lifecycle Event)
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:05:42 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:05:42 user nova-compute[72904]: INFO nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 27 05:05:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:05:42 user nova-compute[72904]: INFO nova.compute.manager [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Took 7.88 seconds to build instance.
Aug 27 05:05:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a3e492a0-0cf7-405c-bae2-e68df8dfa753 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.999s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Terminating instance
Aug 27 05:05:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-1cb321bd-959e-481b-9a4d-a921d4c000e4 req-b1ae3b80-9b21-4560-a184-1eb6922a3053 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1cb321bd-959e-481b-9a4d-a921d4c000e4 req-b1ae3b80-9b21-4560-a184-1eb6922a3053 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1cb321bd-959e-481b-9a4d-a921d4c000e4 req-b1ae3b80-9b21-4560-a184-1eb6922a3053 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1cb321bd-959e-481b-9a4d-a921d4c000e4 req-b1ae3b80-9b21-4560-a184-1eb6922a3053 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-1cb321bd-959e-481b-9a4d-a921d4c000e4 req-b1ae3b80-9b21-4560-a184-1eb6922a3053 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-1cb321bd-959e-481b-9a4d-a921d4c000e4 req-b1ae3b80-9b21-4560-a184-1eb6922a3053 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-unplugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:58 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Instance destroyed successfully.
Aug 27 05:05:58 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lazy-loading 'resources' on Instance uuid cae1202f-0f6c-437e-8334-215b4736e061 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1516546030',display_name='tempest-ServerStableDeviceRescueTest-server-1516546030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1516546030',id=3,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXPJ3ICrlA/cmQIas/XcCpHwfVtvqbwe/pMXrS60OLOmiDcBvKM4sTK5i5N1RlrmPCuHF7isVXR3d9y/cD+PEQxszneeTg/yBdt9s6dYyPTX8VIAzpg+mXwOatTCMOmww==',key_name='tempest-keypair-509925292',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26df968c46154c42bd5889d09318bbe2',ramdisk_id='',reservation_id='r-7xre0f4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-117364697',owner_user_name='tempest-ServerStableDeviceRescueTest-117364697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f916716b9147f28b371d499b31aff8',uuid=cae1202f-0f6c-437e-8334-215b4736e061,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converting VIF {"id": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "address": "fa:16:3e:ff:37:d6", "network": {"id": "7f97ecdd-abe1-4582-8397-82b0647b9492", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-922475700-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26df968c46154c42bd5889d09318bbe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25f639bd-e9", "ovs_interfaceid": "25f639bd-e92f-45c8-be05-fe92c4ee4e39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG os_vif [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25f639bd-e9, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:05:58 user nova-compute[72904]: INFO os_vif [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:37:d6,bridge_name='br-int',has_traffic_filtering=True,id=25f639bd-e92f-45c8-be05-fe92c4ee4e39,network=Network(7f97ecdd-abe1-4582-8397-82b0647b9492),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25f639bd-e9')
Aug 27 05:05:58 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Deleting instance files /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061_del
Aug 27 05:05:58 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Deletion of /opt/stack/data/nova/instances/cae1202f-0f6c-437e-8334-215b4736e061_del complete
Aug 27 05:05:58 user nova-compute[72904]: INFO nova.compute.manager [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 05:05:58 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:05:58 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:05:59 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Took 0.92 seconds to deallocate network for instance.
Aug 27 05:05:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:59 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Deleted allocations for instance cae1202f-0f6c-437e-8334-215b4736e061
Aug 27 05:05:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6de304dc-990b-4c0c-80f1-2c62a664800b tempest-ServerStableDeviceRescueTest-117364697 tempest-ServerStableDeviceRescueTest-117364697-project-member] Lock "cae1202f-0f6c-437e-8334-215b4736e061" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-8faf58ab-afe7-4636-a0c2-c2bce6c24771 req-59d427ce-675d-4b95-971b-12832007afe6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8faf58ab-afe7-4636-a0c2-c2bce6c24771 req-59d427ce-675d-4b95-971b-12832007afe6 service nova] Acquiring lock "cae1202f-0f6c-437e-8334-215b4736e061-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8faf58ab-afe7-4636-a0c2-c2bce6c24771 req-59d427ce-675d-4b95-971b-12832007afe6 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8faf58ab-afe7-4636-a0c2-c2bce6c24771 req-59d427ce-675d-4b95-971b-12832007afe6 service nova] Lock "cae1202f-0f6c-437e-8334-215b4736e061-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:05:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-8faf58ab-afe7-4636-a0c2-c2bce6c24771 req-59d427ce-675d-4b95-971b-12832007afe6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] No waiting events found dispatching network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:05:59 user nova-compute[72904]: WARNING nova.compute.manager [req-8faf58ab-afe7-4636-a0c2-c2bce6c24771 req-59d427ce-675d-4b95-971b-12832007afe6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received unexpected event network-vif-plugged-25f639bd-e92f-45c8-be05-fe92c4ee4e39 for instance with vm_state deleted and task_state None.
Aug 27 05:05:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-8faf58ab-afe7-4636-a0c2-c2bce6c24771 req-59d427ce-675d-4b95-971b-12832007afe6 service nova] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Received event network-vif-deleted-25f639bd-e92f-45c8-be05-fe92c4ee4e39 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-changed-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Refreshing instance network info cache due to event network-changed-d634d4ec-3655-45de-860f-ba7e1a7e3455. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:06:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] Acquiring lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:06:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] Acquired lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:06:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Refreshing network info cache for port d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:06:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updated VIF entry in instance network info cache for port d634d4ec-3655-45de-860f-ba7e1a7e3455. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:06:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:06:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-179a897f-e1e9-4bba-9901-d6bbe4fdf816 req-b7d4082d-a4c4-44f6-a355-b87dcf19681b service nova] Releasing lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:06:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:12 user nova-compute[72904]: INFO nova.compute.manager [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Attaching volume 222fb851-f74c-4c2f-a2fb-70878da61f9f to /dev/vdb
Aug 27 05:06:12 user nova-compute[72904]: DEBUG os_brick.utils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9cb78-ca03-4ab0-b2d0-bb4e553e1606]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[db040321-26d0-4342-ad16-05768b956cd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d5ebf-2ca4-49d5-901e-7b60a7d9284e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367a2b1-fc37-4b92-bd3d-8f8a666f1a9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:06:12 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:06:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ac1ca-a425-4144-a3b2-c9ac8c6d67a9]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG os_brick.utils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:06:12 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating existing volume attachment record: ed4e2d88-9b3d-4535-9f02-6d02a78bd032 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112758.1953351, cae1202f-0f6c-437e-8334-215b4736e061 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:06:13 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: cae1202f-0f6c-437e-8334-215b4736e061] VM Stopped (Lifecycle Event)
Aug 27 05:06:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-624b61ef-8891-44f4-83a4-6c5460649395 None None] [instance: cae1202f-0f6c-437e-8334-215b4736e061] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "f133a8ca-d56a-4f26-a78d-e86278874028" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "f133a8ca-d56a-4f26-a78d-e86278874028" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:13 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:06:13 user nova-compute[72904]: INFO nova.compute.claims [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Claim successful on node user
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:06:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:06:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Creating image(s)
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "/opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "/opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "/opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG nova.policy [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3d740e551194721a014f41d24766c7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ec6462e9c94fa094acced522fb7e18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.223s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk 1073741824" returned: 0 in 0.062s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.215s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Cannot resize image /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Ensure instance console log exists: /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Successfully created port: d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Successfully updated port: d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "refresh_cache-f133a8ca-d56a-4f26-a78d-e86278874028" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquired lock "refresh_cache-f133a8ca-d56a-4f26-a78d-e86278874028" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received event network-changed-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Refreshing instance network info cache due to event network-changed-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] Acquiring lock "refresh_cache-f133a8ca-d56a-4f26-a78d-e86278874028" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Updating instance_info_cache with network_info: [{"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Releasing lock "refresh_cache-f133a8ca-d56a-4f26-a78d-e86278874028" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Instance network_info: |[{"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] Acquired lock "refresh_cache-f133a8ca-d56a-4f26-a78d-e86278874028" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.neutron [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Refreshing network info cache for port d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Start _get_guest_xml network_info=[{"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:06:17 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:06:17 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2074155991',display_name='tempest-VolumesNegativeTest-instance-2074155991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2074155991',id=19,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ec6462e9c94fa094acced522fb7e18',ramdisk_id='',reservation_id='r-8vhkl1f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1359696363',owner_user_name='tempest-VolumesNegativeTest-1359696363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:06:14Z,user_data=None,user_id='c3d740e551194721a014f41d24766c7e',uuid=f133a8ca-d56a-4f26-a78d-e86278874028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Converting VIF {"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:68:31,bridge_name='br-int',has_traffic_filtering=True,id=d5cb2644-7330-444c-b2b3-7bf7af7ae9b2,network=Network(de91877c-db04-45e3-a369-49a51a240ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cb2644-73') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lazy-loading 'pci_devices' on Instance uuid f133a8ca-d56a-4f26-a78d-e86278874028 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:06:17 user nova-compute[72904]:   <uuid>f133a8ca-d56a-4f26-a78d-e86278874028</uuid>
Aug 27 05:06:17 user nova-compute[72904]:   <name>instance-00000013</name>
Aug 27 05:06:17 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:06:17 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:06:17 user nova-compute[72904]:   <metadata>
Aug 27 05:06:17 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:06:17 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:06:17 user nova-compute[72904]:       <nova:name>tempest-VolumesNegativeTest-instance-2074155991</nova:name>
Aug 27 05:06:17 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:06:17</nova:creationTime>
Aug 27 05:06:17 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:06:17 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:06:17 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:06:17 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:06:17 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:06:17 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:06:17 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:06:17 user nova-compute[72904]:       <nova:owner>
Aug 27 05:06:17 user nova-compute[72904]:         <nova:user uuid="c3d740e551194721a014f41d24766c7e">tempest-VolumesNegativeTest-1359696363-project-member</nova:user>
Aug 27 05:06:17 user nova-compute[72904]:         <nova:project uuid="29ec6462e9c94fa094acced522fb7e18">tempest-VolumesNegativeTest-1359696363</nova:project>
Aug 27 05:06:17 user nova-compute[72904]:       </nova:owner>
Aug 27 05:06:17 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:06:17 user nova-compute[72904]:       <nova:ports>
Aug 27 05:06:17 user nova-compute[72904]:         <nova:port uuid="d5cb2644-7330-444c-b2b3-7bf7af7ae9b2">
Aug 27 05:06:17 user nova-compute[72904]:           <nova:ip type="fixed" address="192.168.233.96" ipVersion="4"/>
Aug 27 05:06:17 user nova-compute[72904]:         </nova:port>
Aug 27 05:06:17 user nova-compute[72904]:       </nova:ports>
Aug 27 05:06:17 user nova-compute[72904]:     </nova:instance>
Aug 27 05:06:17 user nova-compute[72904]:   </metadata>
Aug 27 05:06:17 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:06:17 user nova-compute[72904]:     <system>
Aug 27 05:06:17 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:06:17 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:06:17 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:06:17 user nova-compute[72904]:       <entry name="serial">f133a8ca-d56a-4f26-a78d-e86278874028</entry>
Aug 27 05:06:17 user nova-compute[72904]:       <entry name="uuid">f133a8ca-d56a-4f26-a78d-e86278874028</entry>
Aug 27 05:06:17 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:06:17 user nova-compute[72904]:     </system>
Aug 27 05:06:17 user nova-compute[72904]:   </sysinfo>
Aug 27 05:06:17 user nova-compute[72904]:   <os>
Aug 27 05:06:17 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:06:17 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:06:17 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:06:17 user nova-compute[72904]:   </os>
Aug 27 05:06:17 user nova-compute[72904]:   <features>
Aug 27 05:06:17 user nova-compute[72904]:     <acpi/>
Aug 27 05:06:17 user nova-compute[72904]:     <apic/>
Aug 27 05:06:17 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:06:17 user nova-compute[72904]:   </features>
Aug 27 05:06:17 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:06:17 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:06:17 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:06:17 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:06:17 user nova-compute[72904]:   </clock>
Aug 27 05:06:17 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:06:17 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:06:17 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:06:17 user nova-compute[72904]:   </cpu>
Aug 27 05:06:17 user nova-compute[72904]:   <devices>
Aug 27 05:06:17 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:06:17 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:06:17 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk"/>
Aug 27 05:06:17 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:06:17 user nova-compute[72904]:     </disk>
Aug 27 05:06:17 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:06:17 user nova-compute[72904]:       <mac address="fa:16:3e:e4:68:31"/>
Aug 27 05:06:17 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:06:17 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:06:17 user nova-compute[72904]:       <target dev="tapd5cb2644-73"/>
Aug 27 05:06:17 user nova-compute[72904]:     </interface>
Aug 27 05:06:17 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:06:17 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/console.log" append="off"/>
Aug 27 05:06:17 user nova-compute[72904]:     </serial>
Aug 27 05:06:17 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:06:17 user nova-compute[72904]:     <video>
Aug 27 05:06:17 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:06:17 user nova-compute[72904]:     </video>
Aug 27 05:06:17 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:06:17 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:06:17 user nova-compute[72904]:     </rng>
Aug 27 05:06:17 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:06:17 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:06:17 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:06:17 user nova-compute[72904]:     </memballoon>
Aug 27 05:06:17 user nova-compute[72904]:   </devices>
Aug 27 05:06:17 user nova-compute[72904]: </domain>
Aug 27 05:06:17 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2074155991',display_name='tempest-VolumesNegativeTest-instance-2074155991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2074155991',id=19,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ec6462e9c94fa094acced522fb7e18',ramdisk_id='',reservation_id='r-8vhkl1f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1359696363',owner_user_name='tempest-VolumesNegativeTest-1359696363-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:06:14Z,user_data=None,user_id='c3d740e551194721a014f41d24766c7e',uuid=f133a8ca-d56a-4f26-a78d-e86278874028,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Converting VIF {"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:68:31,bridge_name='br-int',has_traffic_filtering=True,id=d5cb2644-7330-444c-b2b3-7bf7af7ae9b2,network=Network(de91877c-db04-45e3-a369-49a51a240ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cb2644-73') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG os_vif [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:68:31,bridge_name='br-int',has_traffic_filtering=True,id=d5cb2644-7330-444c-b2b3-7bf7af7ae9b2,network=Network(de91877c-db04-45e3-a369-49a51a240ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cb2644-73') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5cb2644-73, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5cb2644-73, col_values=(('external_ids', {'iface-id': 'd5cb2644-7330-444c-b2b3-7bf7af7ae9b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:68:31', 'vm-uuid': 'f133a8ca-d56a-4f26-a78d-e86278874028'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:06:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:17 user nova-compute[72904]: INFO os_vif [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:68:31,bridge_name='br-int',has_traffic_filtering=True,id=d5cb2644-7330-444c-b2b3-7bf7af7ae9b2,network=Network(de91877c-db04-45e3-a369-49a51a240ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cb2644-73')
Aug 27 05:06:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:06:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] No VIF found with MAC fa:16:3e:e4:68:31, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:06:18 user nova-compute[72904]: DEBUG nova.network.neutron [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Updated VIF entry in instance network info cache for port d5cb2644-7330-444c-b2b3-7bf7af7ae9b2. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:06:18 user nova-compute[72904]: DEBUG nova.network.neutron [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Updating instance_info_cache with network_info: [{"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:06:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d2cfb475-2450-4683-a8fa-b80623d6c792 req-3f44c032-501f-4093-8460-defdf32cae0b service nova] Releasing lock "refresh_cache-f133a8ca-d56a-4f26-a78d-e86278874028" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-bbbb8b49-8f21-4edf-b419-100cab41d904 req-20ac8773-16f3-4d6d-8832-91af267a7a54 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received event network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bbbb8b49-8f21-4edf-b419-100cab41d904 req-20ac8773-16f3-4d6d-8832-91af267a7a54 service nova] Acquiring lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bbbb8b49-8f21-4edf-b419-100cab41d904 req-20ac8773-16f3-4d6d-8832-91af267a7a54 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bbbb8b49-8f21-4edf-b419-100cab41d904 req-20ac8773-16f3-4d6d-8832-91af267a7a54 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-bbbb8b49-8f21-4edf-b419-100cab41d904 req-20ac8773-16f3-4d6d-8832-91af267a7a54 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] No waiting events found dispatching network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:06:19 user nova-compute[72904]: WARNING nova.compute.manager [req-bbbb8b49-8f21-4edf-b419-100cab41d904 req-20ac8773-16f3-4d6d-8832-91af267a7a54 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received unexpected event network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 for instance with vm_state building and task_state spawning.
Aug 27 05:06:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112781.7579036, f133a8ca-d56a-4f26-a78d-e86278874028 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:06:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] VM Resumed (Lifecycle Event)
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:06:21 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Instance spawned successfully.
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112781.761396, f133a8ca-d56a-4f26-a78d-e86278874028 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:06:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] VM Started (Lifecycle Event)
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:06:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:06:21 user nova-compute[72904]: INFO nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Took 7.40 seconds to spawn the instance on the hypervisor.
Aug 27 05:06:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:21 user nova-compute[72904]: INFO nova.compute.manager [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Took 8.14 seconds to build instance.
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5cf76cec-7b09-4f24-a24e-8d5ad7c6941f tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "f133a8ca-d56a-4f26-a78d-e86278874028" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.250s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-856f9a0d-554d-4092-85ce-48750a332ee7 req-113912b9-8f91-4510-ac60-991e54becb19 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received event network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-856f9a0d-554d-4092-85ce-48750a332ee7 req-113912b9-8f91-4510-ac60-991e54becb19 service nova] Acquiring lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-856f9a0d-554d-4092-85ce-48750a332ee7 req-113912b9-8f91-4510-ac60-991e54becb19 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-856f9a0d-554d-4092-85ce-48750a332ee7 req-113912b9-8f91-4510-ac60-991e54becb19 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-856f9a0d-554d-4092-85ce-48750a332ee7 req-113912b9-8f91-4510-ac60-991e54becb19 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] No waiting events found dispatching network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:06:22 user nova-compute[72904]: WARNING nova.compute.manager [req-856f9a0d-554d-4092-85ce-48750a332ee7 req-113912b9-8f91-4510-ac60-991e54becb19 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received unexpected event network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 for instance with vm_state active and task_state None.
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgbdVSzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:06:24 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:06:24 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:06:24 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d7e68f-1697-4338-8b7a-bb92c1855bd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:06:24 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[72596088-4df9-4e4d-8cae-0a03a76e5cd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f] added
Aug 27 05:06:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef258ff-5623-4cdd-9b6e-773b58fe95ad]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d187b5-6e62-4313-abc5-f9aff18c4266]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgbdVSzm {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgbdVSzm" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cb025e-98d9-4077-a157-ec123f767d4c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgbdVSzm'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4306e9b8-0bb0-4dd2-a2af-c72832e2a8c3]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[423e4885-84e0-487b-a7ca-b540b66a8131]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:06:25 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:06:25 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d9f6e4-9ba6-4931-b3d7-c79159db0d1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]
Aug 27 05:06:25 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.
Aug 27 05:06:25 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3cccd2-6ceb-43fb-ae43-cfd0567cb1da]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[482f9de9-e2a2-4ff6-800e-7a2747a5f8ac]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:06:25 user nova-compute[72904]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:06:25 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:06:25 user nova-compute[72904]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:06:25 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aed760-640b-4005-aa5e-602964b1e3b6]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgbdVSzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.826s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== connect_volume: return (1830ms) {'type': 'block', 'scsi_wwn': '26237636662613837', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237636662613837', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:06:26 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:06:26 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7477MB free_disk=25.74231719970703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:06:26 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:06:26 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:06:26 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:06:26 user nova-compute[72904]:   <serial>222fb851-f74c-4c2f-a2fb-70878da61f9f</serial>
Aug 27 05:06:26 user nova-compute[72904]: </disk>
Aug 27 05:06:26 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d6410a72-6124-440e-a891-3f0dfc2aa2d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f133a8ca-d56a-4f26-a78d-e86278874028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:06:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No VIF found with MAC fa:16:3e:18:1b:7a, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cee28d29-6b35-41eb-a877-2339e5428346 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.163s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-674d5fd3-9f52-46d0-8b4b-d42e5f857887 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-674d5fd3-9f52-46d0-8b4b-d42e5f857887 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-674d5fd3-9f52-46d0-8b4b-d42e5f857887 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-674d5fd3-9f52-46d0-8b4b-d42e5f857887 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72904) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG nova.objects.instance [None req-674d5fd3-9f52-46d0-8b4b-d42e5f857887 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-a8e834b3-6119-4f3f-a2aa-cf364be91fe6 req-a22b7e13-8b1a-4638-88b0-82081a711e66 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a8e834b3-6119-4f3f-a2aa-cf364be91fe6 req-a22b7e13-8b1a-4638-88b0-82081a711e66 service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a8e834b3-6119-4f3f-a2aa-cf364be91fe6 req-a22b7e13-8b1a-4638-88b0-82081a711e66 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a8e834b3-6119-4f3f-a2aa-cf364be91fe6 req-a22b7e13-8b1a-4638-88b0-82081a711e66 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-a8e834b3-6119-4f3f-a2aa-cf364be91fe6 req-a22b7e13-8b1a-4638-88b0-82081a711e66 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:06:28 user nova-compute[72904]: WARNING nova.compute.manager [req-a8e834b3-6119-4f3f-a2aa-cf364be91fe6 req-a22b7e13-8b1a-4638-88b0-82081a711e66 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state active and task_state powering-off.
Aug 27 05:06:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance destroyed successfully.
Aug 27 05:06:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-674d5fd3-9f52-46d0-8b4b-d42e5f857887 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-674d5fd3-9f52-46d0-8b4b-d42e5f857887 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.010s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [{"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-d57daa0e-5ce0-47cb-90f1-c4327bca54a0" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:06:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:06:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b51299e-23bf-4d0a-8426-efc63e41fb7c req-e6ae68ef-6ef6-4c56-a4c5-279eaa3dc94e service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b51299e-23bf-4d0a-8426-efc63e41fb7c req-e6ae68ef-6ef6-4c56-a4c5-279eaa3dc94e service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b51299e-23bf-4d0a-8426-efc63e41fb7c req-e6ae68ef-6ef6-4c56-a4c5-279eaa3dc94e service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3b51299e-23bf-4d0a-8426-efc63e41fb7c req-e6ae68ef-6ef6-4c56-a4c5-279eaa3dc94e service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-3b51299e-23bf-4d0a-8426-efc63e41fb7c req-e6ae68ef-6ef6-4c56-a4c5-279eaa3dc94e service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:06:30 user nova-compute[72904]: WARNING nova.compute.manager [req-3b51299e-23bf-4d0a-8426-efc63e41fb7c req-e6ae68ef-6ef6-4c56-a4c5-279eaa3dc94e service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state stopped and task_state None.
Aug 27 05:06:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:35 user nova-compute[72904]: INFO nova.compute.manager [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] instance snapshotting
Aug 27 05:06:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Beginning live snapshot process
Aug 27 05:06:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json -f qcow2" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:06:36 user nova-compute[72904]: INFO nova.compute.claims [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Claim successful on node user
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp48kvsogb/a32117c51ecd42e7a6a3e5ec67ce08aa.delta 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp48kvsogb/a32117c51ecd42e7a6a3e5ec67ce08aa.delta 1073741824" returned: 0 in 0.055s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 05:06:36 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:06:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:06:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:06:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG nova.policy [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14df3bfebe7c43dca0a4ef2ee90f995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553916b16f8404ca042ad82b503e6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:06:37 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Creating image(s)
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "/opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "/opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "/opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.212s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk 1073741824" returned: 0 in 0.096s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.227s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:06:37 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 05:06:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Successfully created port: 4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp48kvsogb/a32117c51ecd42e7a6a3e5ec67ce08aa.delta /opt/stack/data/nova/instances/snapshots/tmp48kvsogb/a32117c51ecd42e7a6a3e5ec67ce08aa {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Cannot resize image /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Ensure instance console log exists: /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp48kvsogb/a32117c51ecd42e7a6a3e5ec67ce08aa.delta /opt/stack/data/nova/instances/snapshots/tmp48kvsogb/a32117c51ecd42e7a6a3e5ec67ce08aa" returned: 0 in 0.672s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:06:38 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Snapshot extracted, beginning image upload
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Successfully updated port: 4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquired lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-changed-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Refreshing instance network info cache due to event network-changed-4dc0a45b-3038-4833-87a3-0293e49b4522. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] Acquiring lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Releasing lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Instance network_info: |[{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] Acquired lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.network.neutron [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Refreshing network info cache for port 4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Start _get_guest_xml network_info=[{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:06:39 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:06:39 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:06:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2116260090',display_name='tempest-ServerActionsTestOtherA-server-2116260090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2116260090',id=20,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-ipmrv07r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:60:90,bridge_name='br-int',has_traffic_filtering=True,id=4dc0a45b-3038-4833-87a3-0293e49b4522,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc0a45b-30') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'pci_devices' on Instance uuid eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:06:40 user nova-compute[72904]:   <uuid>eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f</uuid>
Aug 27 05:06:40 user nova-compute[72904]:   <name>instance-00000014</name>
Aug 27 05:06:40 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:06:40 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:06:40 user nova-compute[72904]:   <metadata>
Aug 27 05:06:40 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:06:40 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:06:40 user nova-compute[72904]:       <nova:name>tempest-ServerActionsTestOtherA-server-2116260090</nova:name>
Aug 27 05:06:40 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:06:39</nova:creationTime>
Aug 27 05:06:40 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:06:40 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:06:40 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:06:40 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:06:40 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:06:40 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:06:40 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:06:40 user nova-compute[72904]:       <nova:owner>
Aug 27 05:06:40 user nova-compute[72904]:         <nova:user uuid="14df3bfebe7c43dca0a4ef2ee90f995b">tempest-ServerActionsTestOtherA-886850923-project-member</nova:user>
Aug 27 05:06:40 user nova-compute[72904]:         <nova:project uuid="a553916b16f8404ca042ad82b503e6c7">tempest-ServerActionsTestOtherA-886850923</nova:project>
Aug 27 05:06:40 user nova-compute[72904]:       </nova:owner>
Aug 27 05:06:40 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:06:40 user nova-compute[72904]:       <nova:ports>
Aug 27 05:06:40 user nova-compute[72904]:         <nova:port uuid="4dc0a45b-3038-4833-87a3-0293e49b4522">
Aug 27 05:06:40 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 05:06:40 user nova-compute[72904]:         </nova:port>
Aug 27 05:06:40 user nova-compute[72904]:       </nova:ports>
Aug 27 05:06:40 user nova-compute[72904]:     </nova:instance>
Aug 27 05:06:40 user nova-compute[72904]:   </metadata>
Aug 27 05:06:40 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:06:40 user nova-compute[72904]:     <system>
Aug 27 05:06:40 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:06:40 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:06:40 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:06:40 user nova-compute[72904]:       <entry name="serial">eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f</entry>
Aug 27 05:06:40 user nova-compute[72904]:       <entry name="uuid">eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f</entry>
Aug 27 05:06:40 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:06:40 user nova-compute[72904]:     </system>
Aug 27 05:06:40 user nova-compute[72904]:   </sysinfo>
Aug 27 05:06:40 user nova-compute[72904]:   <os>
Aug 27 05:06:40 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:06:40 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:06:40 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:06:40 user nova-compute[72904]:   </os>
Aug 27 05:06:40 user nova-compute[72904]:   <features>
Aug 27 05:06:40 user nova-compute[72904]:     <acpi/>
Aug 27 05:06:40 user nova-compute[72904]:     <apic/>
Aug 27 05:06:40 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:06:40 user nova-compute[72904]:   </features>
Aug 27 05:06:40 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:06:40 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:06:40 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:06:40 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:06:40 user nova-compute[72904]:   </clock>
Aug 27 05:06:40 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:06:40 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:06:40 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:06:40 user nova-compute[72904]:   </cpu>
Aug 27 05:06:40 user nova-compute[72904]:   <devices>
Aug 27 05:06:40 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:06:40 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:06:40 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk"/>
Aug 27 05:06:40 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:06:40 user nova-compute[72904]:     </disk>
Aug 27 05:06:40 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:06:40 user nova-compute[72904]:       <mac address="fa:16:3e:6a:60:90"/>
Aug 27 05:06:40 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:06:40 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:06:40 user nova-compute[72904]:       <target dev="tap4dc0a45b-30"/>
Aug 27 05:06:40 user nova-compute[72904]:     </interface>
Aug 27 05:06:40 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:06:40 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/console.log" append="off"/>
Aug 27 05:06:40 user nova-compute[72904]:     </serial>
Aug 27 05:06:40 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:06:40 user nova-compute[72904]:     <video>
Aug 27 05:06:40 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:06:40 user nova-compute[72904]:     </video>
Aug 27 05:06:40 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:06:40 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:06:40 user nova-compute[72904]:     </rng>
Aug 27 05:06:40 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:06:40 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:06:40 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:06:40 user nova-compute[72904]:     </memballoon>
Aug 27 05:06:40 user nova-compute[72904]:   </devices>
Aug 27 05:06:40 user nova-compute[72904]: </domain>
Aug 27 05:06:40 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2116260090',display_name='tempest-ServerActionsTestOtherA-server-2116260090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2116260090',id=20,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-ipmrv07r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:06:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:60:90,bridge_name='br-int',has_traffic_filtering=True,id=4dc0a45b-3038-4833-87a3-0293e49b4522,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc0a45b-30') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG os_vif [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:60:90,bridge_name='br-int',has_traffic_filtering=True,id=4dc0a45b-3038-4833-87a3-0293e49b4522,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc0a45b-30') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dc0a45b-30, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4dc0a45b-30, col_values=(('external_ids', {'iface-id': '4dc0a45b-3038-4833-87a3-0293e49b4522', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:60:90', 'vm-uuid': 'eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:40 user nova-compute[72904]: INFO os_vif [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:60:90,bridge_name='br-int',has_traffic_filtering=True,id=4dc0a45b-3038-4833-87a3-0293e49b4522,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc0a45b-30')
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No VIF found with MAC fa:16:3e:6a:60:90, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.network.neutron [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updated VIF entry in instance network info cache for port 4dc0a45b-3038-4833-87a3-0293e49b4522. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG nova.network.neutron [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:06:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e4437a97-5847-4c68-94ae-85a23bfc0ce4 req-c493215b-9d62-4606-96a9-39d7db05fdf8 service nova] Releasing lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2275bfb-4b3c-4b8d-89fb-6c3e8f3c4afb req-259ba389-adc4-485f-9901-72bf8fb1b7d1 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2275bfb-4b3c-4b8d-89fb-6c3e8f3c4afb req-259ba389-adc4-485f-9901-72bf8fb1b7d1 service nova] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2275bfb-4b3c-4b8d-89fb-6c3e8f3c4afb req-259ba389-adc4-485f-9901-72bf8fb1b7d1 service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2275bfb-4b3c-4b8d-89fb-6c3e8f3c4afb req-259ba389-adc4-485f-9901-72bf8fb1b7d1 service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2275bfb-4b3c-4b8d-89fb-6c3e8f3c4afb req-259ba389-adc4-485f-9901-72bf8fb1b7d1 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] No waiting events found dispatching network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:06:41 user nova-compute[72904]: WARNING nova.compute.manager [req-c2275bfb-4b3c-4b8d-89fb-6c3e8f3c4afb req-259ba389-adc4-485f-9901-72bf8fb1b7d1 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received unexpected event network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 for instance with vm_state building and task_state spawning.
Aug 27 05:06:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Snapshot image upload complete
Aug 27 05:06:41 user nova-compute[72904]: INFO nova.compute.manager [None req-1fe171b9-46ff-4226-b5c1-21c6b0102a56 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Took 6.14 seconds to snapshot the instance on the hypervisor.
Aug 27 05:06:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112803.691001, eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:06:43 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] VM Resumed (Lifecycle Event)
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:06:43 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Instance spawned successfully.
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:06:43 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112803.692322, eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:06:43 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] VM Started (Lifecycle Event)
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:06:43 user nova-compute[72904]: INFO nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Took 6.66 seconds to spawn the instance on the hypervisor.
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:43 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-761a3059-0424-48b5-b517-b7b791889c14 req-e5e577bb-33eb-4c56-88f1-325ccab725ca service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-761a3059-0424-48b5-b517-b7b791889c14 req-e5e577bb-33eb-4c56-88f1-325ccab725ca service nova] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-761a3059-0424-48b5-b517-b7b791889c14 req-e5e577bb-33eb-4c56-88f1-325ccab725ca service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-761a3059-0424-48b5-b517-b7b791889c14 req-e5e577bb-33eb-4c56-88f1-325ccab725ca service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-761a3059-0424-48b5-b517-b7b791889c14 req-e5e577bb-33eb-4c56-88f1-325ccab725ca service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] No waiting events found dispatching network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:06:43 user nova-compute[72904]: WARNING nova.compute.manager [req-761a3059-0424-48b5-b517-b7b791889c14 req-e5e577bb-33eb-4c56-88f1-325ccab725ca service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received unexpected event network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 for instance with vm_state building and task_state spawning.
Aug 27 05:06:43 user nova-compute[72904]: INFO nova.compute.manager [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Took 7.53 seconds to build instance.
Aug 27 05:06:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5926acc5-3434-40ac-b79d-849a3e7b8f96 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.640s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:06:44 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112789.510075, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:06:44 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Stopped (Lifecycle Event)
Aug 27 05:06:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a15f01e2-c83b-4502-8e95-8277336b2ee9 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:06:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a15f01e2-c83b-4502-8e95-8277336b2ee9 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:06:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:06:59 user nova-compute[72904]: INFO nova.compute.manager [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Rescuing
Aug 27 05:06:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:06:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:06:59 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance destroyed successfully.
Aug 27 05:07:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Attempting rescue
Aug 27 05:07:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72904) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:07:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Creating image(s)
Aug 27 05:07:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'trusted_certs' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-ab2ad7b3-fe52-4675-9ad6-60605fc8bc22 req-77171389-4174-422a-ba13-c6bc5bd64f0b service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ab2ad7b3-fe52-4675-9ad6-60605fc8bc22 req-77171389-4174-422a-ba13-c6bc5bd64f0b service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ab2ad7b3-fe52-4675-9ad6-60605fc8bc22 req-77171389-4174-422a-ba13-c6bc5bd64f0b service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ab2ad7b3-fe52-4675-9ad6-60605fc8bc22 req-77171389-4174-422a-ba13-c6bc5bd64f0b service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-ab2ad7b3-fe52-4675-9ad6-60605fc8bc22 req-77171389-4174-422a-ba13-c6bc5bd64f0b service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:01 user nova-compute[72904]: WARNING nova.compute.manager [req-ab2ad7b3-fe52-4675-9ad6-60605fc8bc22 req-77171389-4174-422a-ba13-c6bc5bd64f0b service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state active and task_state rescuing.
Aug 27 05:07:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.208s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue" returned: 0 in 0.054s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'migration_context' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.base [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<d0a4c5ee-08b1-49a8-9a9d-135e9db9237b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Start _get_guest_xml network_info=[{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:83:01:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'resources' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.base [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<d0a4c5ee-08b1-49a8-9a9d-135e9db9237b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'numa_topology' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.base [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<d0a4c5ee-08b1-49a8-9a9d-135e9db9237b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:07:01 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:07:01 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'vcpu_model' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.base [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<d0a4c5ee-08b1-49a8-9a9d-135e9db9237b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871237085',display_name='tempest-ServerRescueNegativeTestJSON-server-871237085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871237085',id=17,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-wakr8260',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:20Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=d0a4c5ee-08b1-49a8-9a9d-135e9db9237b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:83:01:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:83:01:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'pci_devices' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.objects.base [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<d0a4c5ee-08b1-49a8-9a9d-135e9db9237b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:07:01 user nova-compute[72904]:   <uuid>d0a4c5ee-08b1-49a8-9a9d-135e9db9237b</uuid>
Aug 27 05:07:01 user nova-compute[72904]:   <name>instance-00000011</name>
Aug 27 05:07:01 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:07:01 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:07:01 user nova-compute[72904]:   <metadata>
Aug 27 05:07:01 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:07:01 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:07:01 user nova-compute[72904]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-871237085</nova:name>
Aug 27 05:07:01 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:07:01</nova:creationTime>
Aug 27 05:07:01 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:07:01 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:07:01 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:07:01 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:07:01 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:07:01 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:07:01 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:07:01 user nova-compute[72904]:       <nova:owner>
Aug 27 05:07:01 user nova-compute[72904]:         <nova:user uuid="223d760d5f03408781a9241f98a5a6c8">tempest-ServerRescueNegativeTestJSON-275121126-project-member</nova:user>
Aug 27 05:07:01 user nova-compute[72904]:         <nova:project uuid="1b16eb565e64463c9a6e61ddcad25728">tempest-ServerRescueNegativeTestJSON-275121126</nova:project>
Aug 27 05:07:01 user nova-compute[72904]:       </nova:owner>
Aug 27 05:07:01 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:07:01 user nova-compute[72904]:       <nova:ports>
Aug 27 05:07:01 user nova-compute[72904]:         <nova:port uuid="14c794cb-b91e-44a9-ab04-1f5e9c51042b">
Aug 27 05:07:01 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:07:01 user nova-compute[72904]:         </nova:port>
Aug 27 05:07:01 user nova-compute[72904]:       </nova:ports>
Aug 27 05:07:01 user nova-compute[72904]:     </nova:instance>
Aug 27 05:07:01 user nova-compute[72904]:   </metadata>
Aug 27 05:07:01 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:07:01 user nova-compute[72904]:     <system>
Aug 27 05:07:01 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:07:01 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:07:01 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:07:01 user nova-compute[72904]:       <entry name="serial">d0a4c5ee-08b1-49a8-9a9d-135e9db9237b</entry>
Aug 27 05:07:01 user nova-compute[72904]:       <entry name="uuid">d0a4c5ee-08b1-49a8-9a9d-135e9db9237b</entry>
Aug 27 05:07:01 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:07:01 user nova-compute[72904]:     </system>
Aug 27 05:07:01 user nova-compute[72904]:   </sysinfo>
Aug 27 05:07:01 user nova-compute[72904]:   <os>
Aug 27 05:07:01 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:07:01 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:07:01 user nova-compute[72904]:   </os>
Aug 27 05:07:01 user nova-compute[72904]:   <features>
Aug 27 05:07:01 user nova-compute[72904]:     <acpi/>
Aug 27 05:07:01 user nova-compute[72904]:     <apic/>
Aug 27 05:07:01 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:07:01 user nova-compute[72904]:   </features>
Aug 27 05:07:01 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:07:01 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:07:01 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:07:01 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:07:01 user nova-compute[72904]:   </clock>
Aug 27 05:07:01 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:07:01 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:07:01 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:07:01 user nova-compute[72904]:   </cpu>
Aug 27 05:07:01 user nova-compute[72904]:   <devices>
Aug 27 05:07:01 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:07:01 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:07:01 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue"/>
Aug 27 05:07:01 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:07:01 user nova-compute[72904]:     </disk>
Aug 27 05:07:01 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:07:01 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:07:01 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk"/>
Aug 27 05:07:01 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:07:01 user nova-compute[72904]:     </disk>
Aug 27 05:07:01 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:07:01 user nova-compute[72904]:       <mac address="fa:16:3e:83:01:a7"/>
Aug 27 05:07:01 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:07:01 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:07:01 user nova-compute[72904]:       <target dev="tap14c794cb-b9"/>
Aug 27 05:07:01 user nova-compute[72904]:     </interface>
Aug 27 05:07:01 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:07:01 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/console.log" append="off"/>
Aug 27 05:07:01 user nova-compute[72904]:     </serial>
Aug 27 05:07:01 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:07:01 user nova-compute[72904]:     <video>
Aug 27 05:07:01 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:07:01 user nova-compute[72904]:     </video>
Aug 27 05:07:01 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:07:01 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:07:01 user nova-compute[72904]:     </rng>
Aug 27 05:07:01 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:07:01 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:07:01 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:07:01 user nova-compute[72904]:     </memballoon>
Aug 27 05:07:01 user nova-compute[72904]:   </devices>
Aug 27 05:07:01 user nova-compute[72904]: </domain>
Aug 27 05:07:01 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:07:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance destroyed successfully.
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:07:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No VIF found with MAC fa:16:3e:83:01:a7, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:07:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-da722d1c-b387-480c-b1d2-d6bb9cd99384 req-a6ad8fba-5335-455e-aee6-618c696a9f57 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-da722d1c-b387-480c-b1d2-d6bb9cd99384 req-a6ad8fba-5335-455e-aee6-618c696a9f57 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-da722d1c-b387-480c-b1d2-d6bb9cd99384 req-a6ad8fba-5335-455e-aee6-618c696a9f57 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-da722d1c-b387-480c-b1d2-d6bb9cd99384 req-a6ad8fba-5335-455e-aee6-618c696a9f57 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-da722d1c-b387-480c-b1d2-d6bb9cd99384 req-a6ad8fba-5335-455e-aee6-618c696a9f57 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:03 user nova-compute[72904]: WARNING nova.compute.manager [req-da722d1c-b387-480c-b1d2-d6bb9cd99384 req-a6ad8fba-5335-455e-aee6-618c696a9f57 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state active and task_state rescuing.
Aug 27 05:07:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:05 user nova-compute[72904]: WARNING nova.compute.manager [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state active and task_state rescuing.
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:05 user nova-compute[72904]: WARNING nova.compute.manager [req-d8b53093-e9bf-40dd-802b-a032270095c6 req-38d19005-7eff-4192-9e29-feaa4a30af1d service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state active and task_state rescuing.
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for d0a4c5ee-08b1-49a8-9a9d-135e9db9237b due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112825.7431462, d0a4c5ee-08b1-49a8-9a9d-135e9db9237b => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:07:05 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] VM Resumed (Lifecycle Event)
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bf9900fd-a4f0-43d0-8084-52b4b0a95a95 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:07:05 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112825.7484233, d0a4c5ee-08b1-49a8-9a9d-135e9db9237b => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:07:05 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] VM Started (Lifecycle Event)
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:07:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:07:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:23 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:07:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:24 user nova-compute[72904]: INFO nova.compute.manager [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Terminating instance
Aug 27 05:07:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-dcbed40d-b2ff-4d18-a02b-c24a238c8874 req-bcdccfbb-1acd-4f3a-8bab-9931b38b5e69 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received event network-vif-unplugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dcbed40d-b2ff-4d18-a02b-c24a238c8874 req-bcdccfbb-1acd-4f3a-8bab-9931b38b5e69 service nova] Acquiring lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dcbed40d-b2ff-4d18-a02b-c24a238c8874 req-bcdccfbb-1acd-4f3a-8bab-9931b38b5e69 service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dcbed40d-b2ff-4d18-a02b-c24a238c8874 req-bcdccfbb-1acd-4f3a-8bab-9931b38b5e69 service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-dcbed40d-b2ff-4d18-a02b-c24a238c8874 req-bcdccfbb-1acd-4f3a-8bab-9931b38b5e69 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] No waiting events found dispatching network-vif-unplugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-dcbed40d-b2ff-4d18-a02b-c24a238c8874 req-bcdccfbb-1acd-4f3a-8bab-9931b38b5e69 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received event network-vif-unplugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:25 user nova-compute[72904]: INFO nova.compute.manager [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Terminating instance
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Instance destroyed successfully.
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lazy-loading 'resources' on Instance uuid d6410a72-6124-440e-a891-3f0dfc2aa2d9 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-427078684',display_name='tempest-VolumesActionsTest-instance-427078684',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-427078684',id=18,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:05:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d44a21df639749929efe405de33b9718',ramdisk_id='',reservation_id='r-r0474yxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1180339496',owner_user_name='tempest-VolumesActionsTest-1180339496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:05:42Z,user_data=None,user_id='a96642953830474a968fbb0a4e21aaaf',uuid=d6410a72-6124-440e-a891-3f0dfc2aa2d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converting VIF {"id": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "address": "fa:16:3e:ff:e8:3c", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7e63889-5f", "ovs_interfaceid": "e7e63889-5fd1-4cd6-b390-c875c6ef5bde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e8:3c,bridge_name='br-int',has_traffic_filtering=True,id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e63889-5f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG os_vif [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e8:3c,bridge_name='br-int',has_traffic_filtering=True,id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e63889-5f') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7e63889-5f, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: INFO os_vif [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:e8:3c,bridge_name='br-int',has_traffic_filtering=True,id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7e63889-5f')
Aug 27 05:07:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Deleting instance files /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9_del
Aug 27 05:07:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Deletion of /opt/stack/data/nova/instances/d6410a72-6124-440e-a891-3f0dfc2aa2d9_del complete
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:25 user nova-compute[72904]: INFO nova.compute.manager [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-e80c33dc-84fc-4563-9878-8797ea2e1b84 req-056aca64-f98c-4925-8ba3-52aa21dd3897 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e80c33dc-84fc-4563-9878-8797ea2e1b84 req-056aca64-f98c-4925-8ba3-52aa21dd3897 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e80c33dc-84fc-4563-9878-8797ea2e1b84 req-056aca64-f98c-4925-8ba3-52aa21dd3897 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e80c33dc-84fc-4563-9878-8797ea2e1b84 req-056aca64-f98c-4925-8ba3-52aa21dd3897 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-e80c33dc-84fc-4563-9878-8797ea2e1b84 req-056aca64-f98c-4925-8ba3-52aa21dd3897 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-e80c33dc-84fc-4563-9878-8797ea2e1b84 req-056aca64-f98c-4925-8ba3-52aa21dd3897 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-unplugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Instance destroyed successfully.
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.objects.instance [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lazy-loading 'resources' on Instance uuid d57daa0e-5ce0-47cb-90f1-c4327bca54a0 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1845492887',display_name='tempest-ServerActionsTestOtherB-server-1845492887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1845492887',id=4,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlHPXtAZ/w95f6bC0EWdIlQSeCHps4y/PzkAzyhvKEpljqrgq2qKvsMykaS4toC0YeURkHQiMJXcJ5Y0W7BLu9hwIY9XZBAh4ci4upPUB0slOisNQlaCHhUA9W53h28Sw==',key_name='tempest-keypair-2013469043',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e36dfaf419f4b78820a3536c6f65ad5',ramdisk_id='',reservation_id='r-c4kakrjq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-30211083',owner_user_name='tempest-ServerActionsTestOtherB-30211083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:05:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58fce22ad00e47498c3cd80b3b6fe458',uuid=d57daa0e-5ce0-47cb-90f1-c4327bca54a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converting VIF {"id": "f4285663-09bc-421f-9017-4c18cf096612", "address": "fa:16:3e:67:1b:45", "network": {"id": "b5ebd76a-1782-4092-8176-f4bacaca712e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2120101558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3e36dfaf419f4b78820a3536c6f65ad5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4285663-09", "ovs_interfaceid": "f4285663-09bc-421f-9017-4c18cf096612", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_vif [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4285663-09, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: INFO os_vif [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:1b:45,bridge_name='br-int',has_traffic_filtering=True,id=f4285663-09bc-421f-9017-4c18cf096612,network=Network(b5ebd76a-1782-4092-8176-f4bacaca712e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4285663-09')
Aug 27 05:07:26 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid 'd6410a72-6124-440e-a891-3f0dfc2aa2d9' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd6410a72-6124-440e-a891-3f0dfc2aa2d9' (instance-00000012)
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZwQYhIgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:07:26 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bf4330-613f-45d7-8918-9c0c9b6d2174]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ec662-0e15-41db-a1bd-5dda51ff454a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:07:26 user nova-compute[72904]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:07:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 (non-flash)
Aug 27 05:07:26 user nova-compute[72904]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:07:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c62add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681'): ({'sdc'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Removing single pathed devices sdc {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad745312-b871-4def-861f-bda25af324ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ed948d-f8af-420c-ad1b-e750f4827463]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Flushing IO for device /dev/sdc {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[01401282-620f-462c-abd3-923fd6355f1e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c475daa-3af0-49e8-aaa3-474d92be9500]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6ede6a56-871b-41d4-9971-1cd8d9b09f73 req-ec7b8896-8f07-4635-a30a-e0a051bcfa67 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received event network-vif-deleted-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:26 user nova-compute[72904]: INFO nova.compute.manager [req-6ede6a56-871b-41d4-9971-1cd8d9b09f73 req-ec7b8896-8f07-4635-a30a-e0a051bcfa67 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Neutron deleted interface e7e63889-5fd1-4cd6-b390-c875c6ef5bde; detaching it from the instance and deleting it from the info cache
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-6ede6a56-871b-41d4-9971-1cd8d9b09f73 req-ec7b8896-8f07-4635-a30a-e0a051bcfa67 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a57fa5-d0c1-4dae-b9f4-91ec6845d117]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Took 0.89 seconds to deallocate network for instance.
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-6ede6a56-871b-41d4-9971-1cd8d9b09f73 req-ec7b8896-8f07-4635-a30a-e0a051bcfa67 service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Detach interface failed, port_id=e7e63889-5fd1-4cd6-b390-c875c6ef5bde, reason: Instance d6410a72-6124-440e-a891-3f0dfc2aa2d9 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d4cb7-57e4-4a14-9380-e584db563e81]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260]
Aug 27 05:07:26 user nova-compute[72904]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681, portal: 172.16.0.220,3260] successful.
Aug 27 05:07:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1f7d270-cd66-43e6-8000-a5fed172d681 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b611ae9a-1844-425e-b2ec-ae805f195afd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] <== disconnect_volume: return (432ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:07:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Deleting instance files /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0_del
Aug 27 05:07:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Deletion of /opt/stack/data/nova/instances/d57daa0e-5ce0-47cb-90f1-c4327bca54a0_del complete
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:26 user nova-compute[72904]: INFO nova.compute.manager [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Took 1.45 seconds to destroy the instance on the hypervisor.
Aug 27 05:07:26 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:07:26 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.641s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-b091512e-0556-4783-8913-94484677fe97 req-5c0a45dc-aee9-4cb9-988b-73df0896d46e service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received event network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b091512e-0556-4783-8913-94484677fe97 req-5c0a45dc-aee9-4cb9-988b-73df0896d46e service nova] Acquiring lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b091512e-0556-4783-8913-94484677fe97 req-5c0a45dc-aee9-4cb9-988b-73df0896d46e service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b091512e-0556-4783-8913-94484677fe97 req-5c0a45dc-aee9-4cb9-988b-73df0896d46e service nova] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-b091512e-0556-4783-8913-94484677fe97 req-5c0a45dc-aee9-4cb9-988b-73df0896d46e service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] No waiting events found dispatching network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:27 user nova-compute[72904]: WARNING nova.compute.manager [req-b091512e-0556-4783-8913-94484677fe97 req-5c0a45dc-aee9-4cb9-988b-73df0896d46e service nova] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Received unexpected event network-vif-plugged-e7e63889-5fd1-4cd6-b390-c875c6ef5bde for instance with vm_state deleted and task_state None.
Aug 27 05:07:27 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Deleted allocations for instance d6410a72-6124-440e-a891-3f0dfc2aa2d9
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bbc9c4d2-7219-4983-8ee3-dcc3d65e3779 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "d6410a72-6124-440e-a891-3f0dfc2aa2d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-cc5abd22-ccab-4cdb-b2dd-17c7c9ea1da4 req-414b4fce-4baa-4a75-8e27-e7aeb7022af8 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cc5abd22-ccab-4cdb-b2dd-17c7c9ea1da4 req-414b4fce-4baa-4a75-8e27-e7aeb7022af8 service nova] Acquiring lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cc5abd22-ccab-4cdb-b2dd-17c7c9ea1da4 req-414b4fce-4baa-4a75-8e27-e7aeb7022af8 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cc5abd22-ccab-4cdb-b2dd-17c7c9ea1da4 req-414b4fce-4baa-4a75-8e27-e7aeb7022af8 service nova] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-cc5abd22-ccab-4cdb-b2dd-17c7c9ea1da4 req-414b4fce-4baa-4a75-8e27-e7aeb7022af8 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] No waiting events found dispatching network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:28 user nova-compute[72904]: WARNING nova.compute.manager [req-cc5abd22-ccab-4cdb-b2dd-17c7c9ea1da4 req-414b4fce-4baa-4a75-8e27-e7aeb7022af8 service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received unexpected event network-vif-plugged-f4285663-09bc-421f-9017-4c18cf096612 for instance with vm_state active and task_state deleting.
Aug 27 05:07:28 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:07:28 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7353MB free_disk=25.623573303222656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:07:28 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Took 1.38 seconds to deallocate network for instance.
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f133a8ca-d56a-4f26-a78d-e86278874028 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-245a610b-ce75-44c8-baae-0b7aed66772e req-21421597-c1d0-4a0d-b5a9-0af53730425d service nova] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Received event network-vif-deleted-f4285663-09bc-421f-9017-4c18cf096612 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:07:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:29 user nova-compute[72904]: INFO nova.compute.manager [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Took 0.85 seconds to detach 1 volumes for instance.
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:29 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Deleted allocations for instance d57daa0e-5ce0-47cb-90f1-c4327bca54a0
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-75afcf6b-7951-4fa9-9baf-9328d67e138c tempest-ServerActionsTestOtherB-30211083 tempest-ServerActionsTestOtherB-30211083-project-member] Lock "d57daa0e-5ce0-47cb-90f1-c4327bca54a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.167s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:07:29 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:07:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:07:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:40 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112845.5483198, d6410a72-6124-440e-a891-3f0dfc2aa2d9 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:07:40 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] VM Stopped (Lifecycle Event)
Aug 27 05:07:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ac3125e-bef7-4919-b130-29e6ce161d9b None None] [instance: d6410a72-6124-440e-a891-3f0dfc2aa2d9] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:07:41 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112846.3029346, d57daa0e-5ce0-47cb-90f1-c4327bca54a0 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:07:41 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] VM Stopped (Lifecycle Event)
Aug 27 05:07:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-37ba4632-6140-4364-99ec-4b9723d5bb4c None None] [instance: d57daa0e-5ce0-47cb-90f1-c4327bca54a0] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:07:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:07:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:07:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:07:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:07:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:56 user nova-compute[72904]: INFO nova.compute.manager [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Terminating instance
Aug 27 05:07:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-ab913822-26cc-4438-80ee-b2fda0dd92d8 req-f05bbb7e-49e3-45b1-b61d-09fa5d481ae2 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received event network-vif-unplugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ab913822-26cc-4438-80ee-b2fda0dd92d8 req-f05bbb7e-49e3-45b1-b61d-09fa5d481ae2 service nova] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ab913822-26cc-4438-80ee-b2fda0dd92d8 req-f05bbb7e-49e3-45b1-b61d-09fa5d481ae2 service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ab913822-26cc-4438-80ee-b2fda0dd92d8 req-f05bbb7e-49e3-45b1-b61d-09fa5d481ae2 service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-ab913822-26cc-4438-80ee-b2fda0dd92d8 req-f05bbb7e-49e3-45b1-b61d-09fa5d481ae2 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] No waiting events found dispatching network-vif-unplugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-ab913822-26cc-4438-80ee-b2fda0dd92d8 req-f05bbb7e-49e3-45b1-b61d-09fa5d481ae2 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received event network-vif-unplugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:07:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Instance destroyed successfully.
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lazy-loading 'resources' on Instance uuid 9ca0a7be-bc37-473c-8523-4808a76a1b5d {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T04:58:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-806519351',display_name='tempest-ServersNegativeTestJSON-server-806519351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-806519351',id=2,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T04:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='639c2163be4446719e85d97984980e7f',ramdisk_id='',reservation_id='r-xt0i02tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1301649002',owner_user_name='tempest-ServersNegativeTestJSON-1301649002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T04:58:46Z,user_data=None,user_id='fcd62b49154b47d58be14586316fc1a3',uuid=9ca0a7be-bc37-473c-8523-4808a76a1b5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converting VIF {"id": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "address": "fa:16:3e:a2:a4:1d", "network": {"id": "7bb0a43a-4b29-48a1-8032-c56ba05e52a8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-688366050-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "639c2163be4446719e85d97984980e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3d0e31c-90", "ovs_interfaceid": "d3d0e31c-9061-4e4e-8729-6726c8b32827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a4:1d,bridge_name='br-int',has_traffic_filtering=True,id=d3d0e31c-9061-4e4e-8729-6726c8b32827,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d0e31c-90') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG os_vif [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a4:1d,bridge_name='br-int',has_traffic_filtering=True,id=d3d0e31c-9061-4e4e-8729-6726c8b32827,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d0e31c-90') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3d0e31c-90, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:07:57 user nova-compute[72904]: INFO os_vif [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a4:1d,bridge_name='br-int',has_traffic_filtering=True,id=d3d0e31c-9061-4e4e-8729-6726c8b32827,network=Network(7bb0a43a-4b29-48a1-8032-c56ba05e52a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3d0e31c-90')
Aug 27 05:07:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Deleting instance files /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d_del
Aug 27 05:07:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Deletion of /opt/stack/data/nova/instances/9ca0a7be-bc37-473c-8523-4808a76a1b5d_del complete
Aug 27 05:07:57 user nova-compute[72904]: INFO nova.compute.manager [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 05:07:57 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:07:57 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:07:58 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:07:58 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Took 0.55 seconds to deallocate network for instance.
Aug 27 05:07:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e014da2-86a9-4cc0-9d6b-f2baaf442606 req-37f4a476-78ad-43d9-b0d2-fc1c12964b93 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received event network-vif-deleted-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:58 user nova-compute[72904]: INFO nova.compute.manager [req-2e014da2-86a9-4cc0-9d6b-f2baaf442606 req-37f4a476-78ad-43d9-b0d2-fc1c12964b93 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Neutron deleted interface d3d0e31c-9061-4e4e-8729-6726c8b32827; detaching it from the instance and deleting it from the info cache
Aug 27 05:07:58 user nova-compute[72904]: DEBUG nova.network.neutron [req-2e014da2-86a9-4cc0-9d6b-f2baaf442606 req-37f4a476-78ad-43d9-b0d2-fc1c12964b93 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:07:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-2e014da2-86a9-4cc0-9d6b-f2baaf442606 req-37f4a476-78ad-43d9-b0d2-fc1c12964b93 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Detach interface failed, port_id=d3d0e31c-9061-4e4e-8729-6726c8b32827, reason: Instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:07:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:58 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:07:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:07:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:58 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Deleted allocations for instance 9ca0a7be-bc37-473c-8523-4808a76a1b5d
Aug 27 05:07:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d36a2f1e-8cea-4306-984b-73d65057130d tempest-ServersNegativeTestJSON-1301649002 tempest-ServersNegativeTestJSON-1301649002-project-member] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-df4c1f44-ece0-4b15-9e47-66f2411ab7d1 req-dfb0d12b-6f5c-4fa5-a238-7982a2f416b1 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received event network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:07:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-df4c1f44-ece0-4b15-9e47-66f2411ab7d1 req-dfb0d12b-6f5c-4fa5-a238-7982a2f416b1 service nova] Acquiring lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:07:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-df4c1f44-ece0-4b15-9e47-66f2411ab7d1 req-dfb0d12b-6f5c-4fa5-a238-7982a2f416b1 service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:07:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-df4c1f44-ece0-4b15-9e47-66f2411ab7d1 req-dfb0d12b-6f5c-4fa5-a238-7982a2f416b1 service nova] Lock "9ca0a7be-bc37-473c-8523-4808a76a1b5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:07:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-df4c1f44-ece0-4b15-9e47-66f2411ab7d1 req-dfb0d12b-6f5c-4fa5-a238-7982a2f416b1 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] No waiting events found dispatching network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:07:59 user nova-compute[72904]: WARNING nova.compute.manager [req-df4c1f44-ece0-4b15-9e47-66f2411ab7d1 req-dfb0d12b-6f5c-4fa5-a238-7982a2f416b1 service nova] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Received unexpected event network-vif-plugged-d3d0e31c-9061-4e4e-8729-6726c8b32827 for instance with vm_state deleted and task_state None.
Aug 27 05:08:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "f133a8ca-d56a-4f26-a78d-e86278874028" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "f133a8ca-d56a-4f26-a78d-e86278874028" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:04 user nova-compute[72904]: INFO nova.compute.manager [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Terminating instance
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-f7ee7622-78df-45c4-acf5-33b3565f8a39 req-3a287841-a4b5-432a-a3de-7602aa304cf2 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received event network-vif-unplugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7ee7622-78df-45c4-acf5-33b3565f8a39 req-3a287841-a4b5-432a-a3de-7602aa304cf2 service nova] Acquiring lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7ee7622-78df-45c4-acf5-33b3565f8a39 req-3a287841-a4b5-432a-a3de-7602aa304cf2 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7ee7622-78df-45c4-acf5-33b3565f8a39 req-3a287841-a4b5-432a-a3de-7602aa304cf2 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-f7ee7622-78df-45c4-acf5-33b3565f8a39 req-3a287841-a4b5-432a-a3de-7602aa304cf2 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] No waiting events found dispatching network-vif-unplugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-f7ee7622-78df-45c4-acf5-33b3565f8a39 req-3a287841-a4b5-432a-a3de-7602aa304cf2 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received event network-vif-unplugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:08:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Instance destroyed successfully.
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lazy-loading 'resources' on Instance uuid f133a8ca-d56a-4f26-a78d-e86278874028 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:06:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2074155991',display_name='tempest-VolumesNegativeTest-instance-2074155991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2074155991',id=19,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:06:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29ec6462e9c94fa094acced522fb7e18',ramdisk_id='',reservation_id='r-8vhkl1f7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1359696363',owner_user_name='tempest-VolumesNegativeTest-1359696363-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:06:22Z,user_data=None,user_id='c3d740e551194721a014f41d24766c7e',uuid=f133a8ca-d56a-4f26-a78d-e86278874028,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Converting VIF {"id": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "address": "fa:16:3e:e4:68:31", "network": {"id": "de91877c-db04-45e3-a369-49a51a240ac1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "649842fbc8094e5480cd5f25d4a75c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5cb2644-73", "ovs_interfaceid": "d5cb2644-7330-444c-b2b3-7bf7af7ae9b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:68:31,bridge_name='br-int',has_traffic_filtering=True,id=d5cb2644-7330-444c-b2b3-7bf7af7ae9b2,network=Network(de91877c-db04-45e3-a369-49a51a240ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cb2644-73') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG os_vif [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:68:31,bridge_name='br-int',has_traffic_filtering=True,id=d5cb2644-7330-444c-b2b3-7bf7af7ae9b2,network=Network(de91877c-db04-45e3-a369-49a51a240ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cb2644-73') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5cb2644-73, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:04 user nova-compute[72904]: INFO os_vif [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:68:31,bridge_name='br-int',has_traffic_filtering=True,id=d5cb2644-7330-444c-b2b3-7bf7af7ae9b2,network=Network(de91877c-db04-45e3-a369-49a51a240ac1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5cb2644-73')
Aug 27 05:08:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Deleting instance files /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028_del
Aug 27 05:08:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Deletion of /opt/stack/data/nova/instances/f133a8ca-d56a-4f26-a78d-e86278874028_del complete
Aug 27 05:08:04 user nova-compute[72904]: INFO nova.compute.manager [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 27 05:08:04 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:08:04 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:08:05 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:05 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Took 0.99 seconds to deallocate network for instance.
Aug 27 05:08:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-efa5550d-8da6-45d9-84a6-9bd1e8b14cbb req-1498227e-e69c-471b-b594-1cd0e8ceaf0d service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received event network-vif-deleted-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:06 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Deleted allocations for instance f133a8ca-d56a-4f26-a78d-e86278874028
Aug 27 05:08:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-07e172d0-f37a-4d0c-9b53-182dcc7d9ded tempest-VolumesNegativeTest-1359696363 tempest-VolumesNegativeTest-1359696363-project-member] Lock "f133a8ca-d56a-4f26-a78d-e86278874028" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-26424e9d-0573-4bc3-a619-f8e0af50a4a7 req-0d925b58-aaca-4e58-8ed9-2f82e8f8d8b4 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received event network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-26424e9d-0573-4bc3-a619-f8e0af50a4a7 req-0d925b58-aaca-4e58-8ed9-2f82e8f8d8b4 service nova] Acquiring lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-26424e9d-0573-4bc3-a619-f8e0af50a4a7 req-0d925b58-aaca-4e58-8ed9-2f82e8f8d8b4 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-26424e9d-0573-4bc3-a619-f8e0af50a4a7 req-0d925b58-aaca-4e58-8ed9-2f82e8f8d8b4 service nova] Lock "f133a8ca-d56a-4f26-a78d-e86278874028-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-26424e9d-0573-4bc3-a619-f8e0af50a4a7 req-0d925b58-aaca-4e58-8ed9-2f82e8f8d8b4 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] No waiting events found dispatching network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:06 user nova-compute[72904]: WARNING nova.compute.manager [req-26424e9d-0573-4bc3-a619-f8e0af50a4a7 req-0d925b58-aaca-4e58-8ed9-2f82e8f8d8b4 service nova] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Received unexpected event network-vif-plugged-d5cb2644-7330-444c-b2b3-7bf7af7ae9b2 for instance with vm_state deleted and task_state None.
Aug 27 05:08:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:12 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112877.7206194, 9ca0a7be-bc37-473c-8523-4808a76a1b5d => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:12 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] VM Stopped (Lifecycle Event)
Aug 27 05:08:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-04fbaa8c-92f4-4a68-8451-50c40a0c7ea3 None None] [instance: 9ca0a7be-bc37-473c-8523-4808a76a1b5d] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "3b659348-f582-4c6e-8152-57c455e8302e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "3b659348-f582-4c6e-8152-57c455e8302e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:08:16 user nova-compute[72904]: INFO nova.compute.claims [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Claim successful on node user
Aug 27 05:08:16 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:08:17 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.policy [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a96642953830474a968fbb0a4e21aaaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd44a21df639749929efe405de33b9718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:08:17 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Creating image(s)
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "/opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "/opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk 1073741824" returned: 0 in 0.055s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Successfully created port: d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:08:17 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Cannot resize image /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Ensure instance console log exists: /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Successfully updated port: d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "refresh_cache-3b659348-f582-4c6e-8152-57c455e8302e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquired lock "refresh_cache-3b659348-f582-4c6e-8152-57c455e8302e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received event network-changed-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Refreshing instance network info cache due to event network-changed-d75fc875-8da3-4605-8630-1f71f91aad5c. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] Acquiring lock "refresh_cache-3b659348-f582-4c6e-8152-57c455e8302e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Updating instance_info_cache with network_info: [{"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Releasing lock "refresh_cache-3b659348-f582-4c6e-8152-57c455e8302e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Instance network_info: |[{"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] Acquired lock "refresh_cache-3b659348-f582-4c6e-8152-57c455e8302e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.network.neutron [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Refreshing network info cache for port d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:08:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Start _get_guest_xml network_info=[{"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:08:19 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:19 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1153422703',display_name='tempest-VolumesActionsTest-instance-1153422703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1153422703',id=21,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d44a21df639749929efe405de33b9718',ramdisk_id='',reservation_id='r-14nrg9tr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1180339496',owner_user_name='tempest-VolumesActionsTest-1180339496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:08:17Z,user_data=None,user_id='a96642953830474a968fbb0a4e21aaaf',uuid=3b659348-f582-4c6e-8152-57c455e8302e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converting VIF {"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=d75fc875-8da3-4605-8630-1f71f91aad5c,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75fc875-8d') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b659348-f582-4c6e-8152-57c455e8302e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:08:19 user nova-compute[72904]:   <uuid>3b659348-f582-4c6e-8152-57c455e8302e</uuid>
Aug 27 05:08:19 user nova-compute[72904]:   <name>instance-00000015</name>
Aug 27 05:08:19 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:08:19 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:08:19 user nova-compute[72904]:   <metadata>
Aug 27 05:08:19 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:08:19 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:08:19 user nova-compute[72904]:       <nova:name>tempest-VolumesActionsTest-instance-1153422703</nova:name>
Aug 27 05:08:19 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:08:19</nova:creationTime>
Aug 27 05:08:19 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:08:19 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:08:19 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:08:19 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:08:19 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:08:19 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:08:19 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:08:19 user nova-compute[72904]:       <nova:owner>
Aug 27 05:08:19 user nova-compute[72904]:         <nova:user uuid="a96642953830474a968fbb0a4e21aaaf">tempest-VolumesActionsTest-1180339496-project-member</nova:user>
Aug 27 05:08:19 user nova-compute[72904]:         <nova:project uuid="d44a21df639749929efe405de33b9718">tempest-VolumesActionsTest-1180339496</nova:project>
Aug 27 05:08:19 user nova-compute[72904]:       </nova:owner>
Aug 27 05:08:19 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:08:19 user nova-compute[72904]:       <nova:ports>
Aug 27 05:08:19 user nova-compute[72904]:         <nova:port uuid="d75fc875-8da3-4605-8630-1f71f91aad5c">
Aug 27 05:08:19 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 05:08:19 user nova-compute[72904]:         </nova:port>
Aug 27 05:08:19 user nova-compute[72904]:       </nova:ports>
Aug 27 05:08:19 user nova-compute[72904]:     </nova:instance>
Aug 27 05:08:19 user nova-compute[72904]:   </metadata>
Aug 27 05:08:19 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:08:19 user nova-compute[72904]:     <system>
Aug 27 05:08:19 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:08:19 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:08:19 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:08:19 user nova-compute[72904]:       <entry name="serial">3b659348-f582-4c6e-8152-57c455e8302e</entry>
Aug 27 05:08:19 user nova-compute[72904]:       <entry name="uuid">3b659348-f582-4c6e-8152-57c455e8302e</entry>
Aug 27 05:08:19 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:08:19 user nova-compute[72904]:     </system>
Aug 27 05:08:19 user nova-compute[72904]:   </sysinfo>
Aug 27 05:08:19 user nova-compute[72904]:   <os>
Aug 27 05:08:19 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:08:19 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:08:19 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:08:19 user nova-compute[72904]:   </os>
Aug 27 05:08:19 user nova-compute[72904]:   <features>
Aug 27 05:08:19 user nova-compute[72904]:     <acpi/>
Aug 27 05:08:19 user nova-compute[72904]:     <apic/>
Aug 27 05:08:19 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:08:19 user nova-compute[72904]:   </features>
Aug 27 05:08:19 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:08:19 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:08:19 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:08:19 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:08:19 user nova-compute[72904]:   </clock>
Aug 27 05:08:19 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:08:19 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:08:19 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:08:19 user nova-compute[72904]:   </cpu>
Aug 27 05:08:19 user nova-compute[72904]:   <devices>
Aug 27 05:08:19 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:08:19 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:08:19 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk"/>
Aug 27 05:08:19 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:08:19 user nova-compute[72904]:     </disk>
Aug 27 05:08:19 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:08:19 user nova-compute[72904]:       <mac address="fa:16:3e:a3:f1:48"/>
Aug 27 05:08:19 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:19 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:08:19 user nova-compute[72904]:       <target dev="tapd75fc875-8d"/>
Aug 27 05:08:19 user nova-compute[72904]:     </interface>
Aug 27 05:08:19 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:08:19 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/console.log" append="off"/>
Aug 27 05:08:19 user nova-compute[72904]:     </serial>
Aug 27 05:08:19 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:08:19 user nova-compute[72904]:     <video>
Aug 27 05:08:19 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:19 user nova-compute[72904]:     </video>
Aug 27 05:08:19 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:08:19 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:08:19 user nova-compute[72904]:     </rng>
Aug 27 05:08:19 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:08:19 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:08:19 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:08:19 user nova-compute[72904]:     </memballoon>
Aug 27 05:08:19 user nova-compute[72904]:   </devices>
Aug 27 05:08:19 user nova-compute[72904]: </domain>
Aug 27 05:08:19 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1153422703',display_name='tempest-VolumesActionsTest-instance-1153422703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1153422703',id=21,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d44a21df639749929efe405de33b9718',ramdisk_id='',reservation_id='r-14nrg9tr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1180339496',owner_user_name='tempest-VolumesActionsTest-1180339496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:08:17Z,user_data=None,user_id='a96642953830474a968fbb0a4e21aaaf',uuid=3b659348-f582-4c6e-8152-57c455e8302e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converting VIF {"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=d75fc875-8da3-4605-8630-1f71f91aad5c,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75fc875-8d') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG os_vif [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=d75fc875-8da3-4605-8630-1f71f91aad5c,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75fc875-8d') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd75fc875-8d, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd75fc875-8d, col_values=(('external_ids', {'iface-id': 'd75fc875-8da3-4605-8630-1f71f91aad5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:f1:48', 'vm-uuid': '3b659348-f582-4c6e-8152-57c455e8302e'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:19 user nova-compute[72904]: INFO os_vif [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=d75fc875-8da3-4605-8630-1f71f91aad5c,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75fc875-8d')
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] No VIF found with MAC fa:16:3e:a3:f1:48, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquired lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'info_cache' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Updated VIF entry in instance network info cache for port d75fc875-8da3-4605-8630-1f71f91aad5c. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Updating instance_info_cache with network_info: [{"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-704d9233-9c1d-41f9-8b78-9a4aa3201047 req-891b1872-568a-4a19-abe0-1361083d861b service nova] Releasing lock "refresh_cache-3b659348-f582-4c6e-8152-57c455e8302e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.objects.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693112884.7365735, f133a8ca-d56a-4f26-a78d-e86278874028 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:19 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] VM Stopped (Lifecycle Event)
Aug 27 05:08:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a5737fe4-fb46-44d1-a6af-407576c5412c None None] [instance: f133a8ca-d56a-4f26-a78d-e86278874028] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Releasing lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:20 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance destroyed successfully.
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'resources' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.objects.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_vif [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd634d4ec-36, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:20 user nova-compute[72904]: INFO os_vif [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36')
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgbdVSzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:08:20 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782f2fb-c60e-4ed1-a253-eb35968d907a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ff150e-6bdf-49a8-9e5c-4ed86be242d6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:20 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:20 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194466a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4059596-115d-44d0-855f-6364ebfb867c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249ca1e-ed12-4e9b-a817-20296dc0de71]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c167c6-2625-4b5e-b2ab-53ba67a59001]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1914816-de1f-4ad1-a3f0-1f9a70a25551]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f1f23d-b5b1-4d01-9359-6d3f88a86045]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f97274-0458-4f8b-a46a-434e002918ad]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]
Aug 27 05:08:20 user nova-compute[72904]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.
Aug 27 05:08:20 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e729145-b47d-453d-8614-31e813631c3a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== disconnect_volume: return (290ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Start _get_guest_xml network_info=[{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ed4e2d88-9b3d-4535-9f02-6d02a78bd032', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgbdVSzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ba4f9f20-2e95-465f-9b3f-4b4712b199ca', 'attached_at': '', 'detached_at': '', 'volume_id': '222fb851-f74c-4c2f-a2fb-70878da61f9f', 'serial': '222fb851-f74c-4c2f-a2fb-70878da61f9f'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'numa_topology' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.objects.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:08:20 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:20 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.objects.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgbdVSzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:08:20 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:08:20 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:08:20 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[179272dc-e284-4e39-aba5-912a478c1df5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:08:20 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61a6ec4-ae84-47fb-b84a-ac60550a8b82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f] added
Aug 27 05:08:20 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c52114d-2e23-4bf8-be3f-d0224eadb983]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fddebc-7080-40f3-82ba-340580aad1e7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgbdVSzm {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MgbdVSzm" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ca8f20-dc30-42c1-bb1a-542633b8472d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MgbdVSzm'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3bb33a-3290-428c-bc33-9bddaea30290]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d75b3f-f61f-4ef4-9d51-8322460a07b9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:08:21 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:08:21 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:08:21 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:08:21 user nova-compute[72904]: 
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[45363601-1532-41de-ac08-994d1fba2013]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]
Aug 27 05:08:21 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.
Aug 27 05:08:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-456e45ec-ed5d-499a-b72d-667c5af53d5f req-53490f2c-8a70-4ebf-9029-9592cdc7683b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received event network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-456e45ec-ed5d-499a-b72d-667c5af53d5f req-53490f2c-8a70-4ebf-9029-9592cdc7683b service nova] Acquiring lock "3b659348-f582-4c6e-8152-57c455e8302e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-456e45ec-ed5d-499a-b72d-667c5af53d5f req-53490f2c-8a70-4ebf-9029-9592cdc7683b service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-456e45ec-ed5d-499a-b72d-667c5af53d5f req-53490f2c-8a70-4ebf-9029-9592cdc7683b service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-456e45ec-ed5d-499a-b72d-667c5af53d5f req-53490f2c-8a70-4ebf-9029-9592cdc7683b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] No waiting events found dispatching network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:21 user nova-compute[72904]: WARNING nova.compute.manager [req-456e45ec-ed5d-499a-b72d-667c5af53d5f req-53490f2c-8a70-4ebf-9029-9592cdc7683b service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received unexpected event network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c for instance with vm_state building and task_state spawning.
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[af93d796-6785-4bcc-aae4-2873fb219d58]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae2f9d5-993e-4f79-a8a4-d5e8f16e7677]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de1551c-7b9b-4dd4-a9a6-4685e609c376]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgbdVSzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '26237636662613837', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237636662613837', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'pci_devices' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.objects.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:08:22 user nova-compute[72904]:   <uuid>ba4f9f20-2e95-465f-9b3f-4b4712b199ca</uuid>
Aug 27 05:08:22 user nova-compute[72904]:   <name>instance-0000000e</name>
Aug 27 05:08:22 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:08:22 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:08:22 user nova-compute[72904]:   <metadata>
Aug 27 05:08:22 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:08:22 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:08:22 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeTestJSON-server-1389826246</nova:name>
Aug 27 05:08:22 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:08:20</nova:creationTime>
Aug 27 05:08:22 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:08:22 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:08:22 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:08:22 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:08:22 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:08:22 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:08:22 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:08:22 user nova-compute[72904]:       <nova:owner>
Aug 27 05:08:22 user nova-compute[72904]:         <nova:user uuid="7a89184799414da9ac135289cc4781ed">tempest-AttachVolumeTestJSON-111990947-project-member</nova:user>
Aug 27 05:08:22 user nova-compute[72904]:         <nova:project uuid="a569f1146db846d7aabf09b5ca515d2d">tempest-AttachVolumeTestJSON-111990947</nova:project>
Aug 27 05:08:22 user nova-compute[72904]:       </nova:owner>
Aug 27 05:08:22 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:08:22 user nova-compute[72904]:       <nova:ports>
Aug 27 05:08:22 user nova-compute[72904]:         <nova:port uuid="d634d4ec-3655-45de-860f-ba7e1a7e3455">
Aug 27 05:08:22 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:08:22 user nova-compute[72904]:         </nova:port>
Aug 27 05:08:22 user nova-compute[72904]:       </nova:ports>
Aug 27 05:08:22 user nova-compute[72904]:     </nova:instance>
Aug 27 05:08:22 user nova-compute[72904]:   </metadata>
Aug 27 05:08:22 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:08:22 user nova-compute[72904]:     <system>
Aug 27 05:08:22 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:08:22 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:08:22 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:08:22 user nova-compute[72904]:       <entry name="serial">ba4f9f20-2e95-465f-9b3f-4b4712b199ca</entry>
Aug 27 05:08:22 user nova-compute[72904]:       <entry name="uuid">ba4f9f20-2e95-465f-9b3f-4b4712b199ca</entry>
Aug 27 05:08:22 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:08:22 user nova-compute[72904]:     </system>
Aug 27 05:08:22 user nova-compute[72904]:   </sysinfo>
Aug 27 05:08:22 user nova-compute[72904]:   <os>
Aug 27 05:08:22 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:08:22 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:08:22 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:08:22 user nova-compute[72904]:   </os>
Aug 27 05:08:22 user nova-compute[72904]:   <features>
Aug 27 05:08:22 user nova-compute[72904]:     <acpi/>
Aug 27 05:08:22 user nova-compute[72904]:     <apic/>
Aug 27 05:08:22 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:08:22 user nova-compute[72904]:   </features>
Aug 27 05:08:22 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:08:22 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:08:22 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:08:22 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:08:22 user nova-compute[72904]:   </clock>
Aug 27 05:08:22 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:08:22 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:08:22 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:08:22 user nova-compute[72904]:   </cpu>
Aug 27 05:08:22 user nova-compute[72904]:   <devices>
Aug 27 05:08:22 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:08:22 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:08:22 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk"/>
Aug 27 05:08:22 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:08:22 user nova-compute[72904]:     </disk>
Aug 27 05:08:22 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:08:22 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:08:22 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:08:22 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:08:22 user nova-compute[72904]:       <serial>222fb851-f74c-4c2f-a2fb-70878da61f9f</serial>
Aug 27 05:08:22 user nova-compute[72904]:     </disk>
Aug 27 05:08:22 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:08:22 user nova-compute[72904]:       <mac address="fa:16:3e:18:1b:7a"/>
Aug 27 05:08:22 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:22 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:08:22 user nova-compute[72904]:       <target dev="tapd634d4ec-36"/>
Aug 27 05:08:22 user nova-compute[72904]:     </interface>
Aug 27 05:08:22 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:08:22 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/console.log" append="off"/>
Aug 27 05:08:22 user nova-compute[72904]:     </serial>
Aug 27 05:08:22 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:08:22 user nova-compute[72904]:     <video>
Aug 27 05:08:22 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:22 user nova-compute[72904]:     </video>
Aug 27 05:08:22 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:08:22 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:08:22 user nova-compute[72904]:     </rng>
Aug 27 05:08:22 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:08:22 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:08:22 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:08:22 user nova-compute[72904]:     </memballoon>
Aug 27 05:08:22 user nova-compute[72904]:   </devices>
Aug 27 05:08:22 user nova-compute[72904]: </domain>
Aug 27 05:08:22 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.objects.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:08:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Cannot resize image /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'migration_context' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.objects.base [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG os_vif [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-7bd94a9c-3dfe-457b-9974-0514110dd011 req-46bbc759-7ef7-4ae0-95ea-5b80267dc5ca service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received event network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7bd94a9c-3dfe-457b-9974-0514110dd011 req-46bbc759-7ef7-4ae0-95ea-5b80267dc5ca service nova] Acquiring lock "3b659348-f582-4c6e-8152-57c455e8302e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7bd94a9c-3dfe-457b-9974-0514110dd011 req-46bbc759-7ef7-4ae0-95ea-5b80267dc5ca service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7bd94a9c-3dfe-457b-9974-0514110dd011 req-46bbc759-7ef7-4ae0-95ea-5b80267dc5ca service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-7bd94a9c-3dfe-457b-9974-0514110dd011 req-46bbc759-7ef7-4ae0-95ea-5b80267dc5ca service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] No waiting events found dispatching network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:23 user nova-compute[72904]: WARNING nova.compute.manager [req-7bd94a9c-3dfe-457b-9974-0514110dd011 req-46bbc759-7ef7-4ae0-95ea-5b80267dc5ca service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received unexpected event network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c for instance with vm_state building and task_state spawning.
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd634d4ec-36, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd634d4ec-36, col_values=(('external_ids', {'iface-id': 'd634d4ec-3655-45de-860f-ba7e1a7e3455', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:1b:7a', 'vm-uuid': 'ba4f9f20-2e95-465f-9b3f-4b4712b199ca'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:23 user nova-compute[72904]: INFO os_vif [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36')
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112903.2774384, 3b659348-f582-4c6e-8152-57c455e8302e => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] VM Resumed (Lifecycle Event)
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:08:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Instance spawned successfully.
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:08:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112903.2797506, 3b659348-f582-4c6e-8152-57c455e8302e => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] VM Started (Lifecycle Event)
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:08:23 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:08:23 user nova-compute[72904]: INFO nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 27 05:08:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:23 user nova-compute[72904]: INFO nova.compute.manager [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Took 6.93 seconds to build instance.
Aug 27 05:08:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-45d677fc-d791-4f1a-a848-70739fdb200f tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "3b659348-f582-4c6e-8152-57c455e8302e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.021s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:24 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-27842ec3-195f-47c1-9f69-503a0140fe9f req-d36e316b-cf38-4552-b68b-57323f9964f0 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-27842ec3-195f-47c1-9f69-503a0140fe9f req-d36e316b-cf38-4552-b68b-57323f9964f0 service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-27842ec3-195f-47c1-9f69-503a0140fe9f req-d36e316b-cf38-4552-b68b-57323f9964f0 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-27842ec3-195f-47c1-9f69-503a0140fe9f req-d36e316b-cf38-4552-b68b-57323f9964f0 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-27842ec3-195f-47c1-9f69-503a0140fe9f req-d36e316b-cf38-4552-b68b-57323f9964f0 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:25 user nova-compute[72904]: WARNING nova.compute.manager [req-27842ec3-195f-47c1-9f69-503a0140fe9f req-d36e316b-cf38-4552-b68b-57323f9964f0 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state stopped and task_state powering-on.
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112907.024042, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Resumed (Lifecycle Event)
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:08:27 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance rebooted successfully.
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-2d82b45d-04a9-4e76-a7ba-66dc6cdb47e9 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:08:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112907.0274107, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Started (Lifecycle Event)
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-ca0043bc-9770-416e-ab19-98486a5c70f3 req-b11809a4-b87c-40fb-bb25-cbabe8d6b7ec service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ca0043bc-9770-416e-ab19-98486a5c70f3 req-b11809a4-b87c-40fb-bb25-cbabe8d6b7ec service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ca0043bc-9770-416e-ab19-98486a5c70f3 req-b11809a4-b87c-40fb-bb25-cbabe8d6b7ec service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ca0043bc-9770-416e-ab19-98486a5c70f3 req-b11809a4-b87c-40fb-bb25-cbabe8d6b7ec service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-ca0043bc-9770-416e-ab19-98486a5c70f3 req-b11809a4-b87c-40fb-bb25-cbabe8d6b7ec service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:27 user nova-compute[72904]: WARNING nova.compute.manager [req-ca0043bc-9770-416e-ab19-98486a5c70f3 req-b11809a4-b87c-40fb-bb25-cbabe8d6b7ec service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state active and task_state None.
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-changed-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Refreshing instance network info cache due to event network-changed-4dc0a45b-3038-4833-87a3-0293e49b4522. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] Acquiring lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] Acquired lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG nova.network.neutron [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Refreshing network info cache for port 4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:28 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:28 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7900MB free_disk=25.722015380859375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3b659348-f582-4c6e-8152-57c455e8302e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updated VIF entry in instance network info cache for port 4dc0a45b-3038-4833-87a3-0293e49b4522. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-db69359b-fad7-4f63-91de-c33b99857428 req-6ab998dc-5f98-4bee-9f1f-1b9e5192e5ee service nova] Releasing lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:08:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:30 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updating instance_info_cache with network_info: [{"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:08:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:08:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:34 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:08:34 user nova-compute[72904]: INFO nova.compute.claims [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Claim successful on node user
Aug 27 05:08:34 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:08:34 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:08:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:08:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:08:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:08:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:08:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:08:35 user nova-compute[72904]: INFO nova.virt.block_device [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Booting with blank volume at /dev/vda
Aug 27 05:08:35 user nova-compute[72904]: DEBUG nova.policy [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4bbded3a71e4d6196d83c1fa5e7a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ae29302d54f8aa82e6c51bbfba65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:08:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Successfully created port: 14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Successfully updated port: 14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-changed-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Refreshing instance network info cache due to event network-changed-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] Acquiring lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance network_info: |[{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] Acquired lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Refreshing network info cache for port 14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updated VIF entry in instance network info cache for port 14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c084ffc5-e766-477d-a190-b6aafa3a692d req-c1aecde9-6d7e-4903-bcb2-a380eac13797 service nova] Releasing lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG os_brick.utils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c616a2-4dee-4c8f-ba90-99c85008629e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4544c863-8f49-42f5-88b9-b8b49fa00d53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b1fc2-afd6-403a-945a-1c19480a0c3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be471b7-e911-4e53-a323-edcd7df17d02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:08:41 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:08:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd740ae5-4b18-4673-a793-13d8e093fe8c]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG os_brick.utils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating existing volume attachment record: 3cb0b045-b030-4a56-a607-9bd3a3db5cf3 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:08:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:08:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:08:43 user nova-compute[72904]: INFO nova.compute.claims [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Claim successful on node user
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.network.neutron [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:08:44 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:08:44 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Creating image(s)
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG nova.policy [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd521a1e127f496fa4e7865cfedf106f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc9180eede040eaa688e81896d5c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk 1073741824" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Successfully created port: 3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Cannot resize image /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Ensure instance console log exists: /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Successfully updated port: 3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquired lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing instance network info cache due to event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] Acquiring lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:08:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Releasing lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance network_info: |[{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] Acquired lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Start _get_guest_xml network_info=[{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:08:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-413967328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-413967328',id=23,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFku25PHmoznQMdudBzjCXX/wLaRl7v7i6gLmaYKiZO6y2ja27uNo/ZvfHD5Y1lw+O/TAAKEsczYCaWj1NTWE1JuUOay9FWnNSMtYenwgtjIhxOEc25uPhOzioyDsk9ig==',key_name='tempest-keypair-272173837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-gy814sik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=f8dad8d9-a024-4f25-b1fa-52424b79b662,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'pci_devices' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:08:47 user nova-compute[72904]:   <uuid>f8dad8d9-a024-4f25-b1fa-52424b79b662</uuid>
Aug 27 05:08:47 user nova-compute[72904]:   <name>instance-00000017</name>
Aug 27 05:08:47 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:08:47 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:08:47 user nova-compute[72904]:   <metadata>
Aug 27 05:08:47 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:08:47 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:08:47 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-413967328</nova:name>
Aug 27 05:08:47 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:08:47</nova:creationTime>
Aug 27 05:08:47 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:08:47 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:08:47 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:08:47 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:08:47 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:08:47 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:08:47 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:08:47 user nova-compute[72904]:       <nova:owner>
Aug 27 05:08:47 user nova-compute[72904]:         <nova:user uuid="bd521a1e127f496fa4e7865cfedf106f">tempest-AttachVolumeShelveTestJSON-1010055172-project-member</nova:user>
Aug 27 05:08:47 user nova-compute[72904]:         <nova:project uuid="0fc9180eede040eaa688e81896d5c3c4">tempest-AttachVolumeShelveTestJSON-1010055172</nova:project>
Aug 27 05:08:47 user nova-compute[72904]:       </nova:owner>
Aug 27 05:08:47 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:08:47 user nova-compute[72904]:       <nova:ports>
Aug 27 05:08:47 user nova-compute[72904]:         <nova:port uuid="3874404d-4f70-43f4-b56b-5d7368b97827">
Aug 27 05:08:47 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 05:08:47 user nova-compute[72904]:         </nova:port>
Aug 27 05:08:47 user nova-compute[72904]:       </nova:ports>
Aug 27 05:08:47 user nova-compute[72904]:     </nova:instance>
Aug 27 05:08:47 user nova-compute[72904]:   </metadata>
Aug 27 05:08:47 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:08:47 user nova-compute[72904]:     <system>
Aug 27 05:08:47 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:08:47 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:08:47 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:08:47 user nova-compute[72904]:       <entry name="serial">f8dad8d9-a024-4f25-b1fa-52424b79b662</entry>
Aug 27 05:08:47 user nova-compute[72904]:       <entry name="uuid">f8dad8d9-a024-4f25-b1fa-52424b79b662</entry>
Aug 27 05:08:47 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:08:47 user nova-compute[72904]:     </system>
Aug 27 05:08:47 user nova-compute[72904]:   </sysinfo>
Aug 27 05:08:47 user nova-compute[72904]:   <os>
Aug 27 05:08:47 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:08:47 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:08:47 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:08:47 user nova-compute[72904]:   </os>
Aug 27 05:08:47 user nova-compute[72904]:   <features>
Aug 27 05:08:47 user nova-compute[72904]:     <acpi/>
Aug 27 05:08:47 user nova-compute[72904]:     <apic/>
Aug 27 05:08:47 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:08:47 user nova-compute[72904]:   </features>
Aug 27 05:08:47 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:08:47 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:08:47 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:08:47 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:08:47 user nova-compute[72904]:   </clock>
Aug 27 05:08:47 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:08:47 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:08:47 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:08:47 user nova-compute[72904]:   </cpu>
Aug 27 05:08:47 user nova-compute[72904]:   <devices>
Aug 27 05:08:47 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:08:47 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:08:47 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk"/>
Aug 27 05:08:47 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:08:47 user nova-compute[72904]:     </disk>
Aug 27 05:08:47 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:08:47 user nova-compute[72904]:       <mac address="fa:16:3e:5b:e0:b5"/>
Aug 27 05:08:47 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:47 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:08:47 user nova-compute[72904]:       <target dev="tap3874404d-4f"/>
Aug 27 05:08:47 user nova-compute[72904]:     </interface>
Aug 27 05:08:47 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:08:47 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/console.log" append="off"/>
Aug 27 05:08:47 user nova-compute[72904]:     </serial>
Aug 27 05:08:47 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:08:47 user nova-compute[72904]:     <video>
Aug 27 05:08:47 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:47 user nova-compute[72904]:     </video>
Aug 27 05:08:47 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:08:47 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:08:47 user nova-compute[72904]:     </rng>
Aug 27 05:08:47 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:08:47 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:08:47 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:08:47 user nova-compute[72904]:     </memballoon>
Aug 27 05:08:47 user nova-compute[72904]:   </devices>
Aug 27 05:08:47 user nova-compute[72904]: </domain>
Aug 27 05:08:47 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-413967328',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-413967328',id=23,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFku25PHmoznQMdudBzjCXX/wLaRl7v7i6gLmaYKiZO6y2ja27uNo/ZvfHD5Y1lw+O/TAAKEsczYCaWj1NTWE1JuUOay9FWnNSMtYenwgtjIhxOEc25uPhOzioyDsk9ig==',key_name='tempest-keypair-272173837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-gy814sik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=f8dad8d9-a024-4f25-b1fa-52424b79b662,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG os_vif [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3874404d-4f, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3874404d-4f, col_values=(('external_ids', {'iface-id': '3874404d-4f70-43f4-b56b-5d7368b97827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:e0:b5', 'vm-uuid': 'f8dad8d9-a024-4f25-b1fa-52424b79b662'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:47 user nova-compute[72904]: INFO os_vif [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f')
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No VIF found with MAC fa:16:3e:5b:e0:b5, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updated VIF entry in instance network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:08:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-83600d21-9a4d-403b-8362-c82e664557ed req-13d0b49d-9d7e-485d-8471-6b497022efc1 service nova] Releasing lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:08:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-10620d3e-7fb6-4fa2-8a64-90d4fe14d553 req-47d61b64-0e7e-43be-9d86-86aac4ce9772 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-10620d3e-7fb6-4fa2-8a64-90d4fe14d553 req-47d61b64-0e7e-43be-9d86-86aac4ce9772 service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-10620d3e-7fb6-4fa2-8a64-90d4fe14d553 req-47d61b64-0e7e-43be-9d86-86aac4ce9772 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-10620d3e-7fb6-4fa2-8a64-90d4fe14d553 req-47d61b64-0e7e-43be-9d86-86aac4ce9772 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-10620d3e-7fb6-4fa2-8a64-90d4fe14d553 req-47d61b64-0e7e-43be-9d86-86aac4ce9772 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:49 user nova-compute[72904]: WARNING nova.compute.manager [req-10620d3e-7fb6-4fa2-8a64-90d4fe14d553 req-47d61b64-0e7e-43be-9d86-86aac4ce9772 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received unexpected event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with vm_state building and task_state spawning.
Aug 27 05:08:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112931.2035472, f8dad8d9-a024-4f25-b1fa-52424b79b662 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] VM Resumed (Lifecycle Event)
Aug 27 05:08:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance spawned successfully.
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112931.2046883, f8dad8d9-a024-4f25-b1fa-52424b79b662 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:08:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] VM Started (Lifecycle Event)
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-f5cc2c5f-a908-4c65-826b-0d829a17550f req-88396a8e-31e7-404d-88f1-db43a261eeda service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f5cc2c5f-a908-4c65-826b-0d829a17550f req-88396a8e-31e7-404d-88f1-db43a261eeda service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f5cc2c5f-a908-4c65-826b-0d829a17550f req-88396a8e-31e7-404d-88f1-db43a261eeda service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f5cc2c5f-a908-4c65-826b-0d829a17550f req-88396a8e-31e7-404d-88f1-db43a261eeda service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-f5cc2c5f-a908-4c65-826b-0d829a17550f req-88396a8e-31e7-404d-88f1-db43a261eeda service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:51 user nova-compute[72904]: WARNING nova.compute.manager [req-f5cc2c5f-a908-4c65-826b-0d829a17550f req-88396a8e-31e7-404d-88f1-db43a261eeda service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received unexpected event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with vm_state building and task_state spawning.
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:08:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:08:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:51 user nova-compute[72904]: INFO nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Took 6.78 seconds to spawn the instance on the hypervisor.
Aug 27 05:08:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:08:51 user nova-compute[72904]: INFO nova.compute.manager [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Took 7.57 seconds to build instance.
Aug 27 05:08:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-80e39d83-fb11-4cd1-a39e-976715c03d41 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.680s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:08:54 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Creating image(s)
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Ensure instance console log exists: /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Start _get_guest_xml network_info=[{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3cb0b045-b030-4a56-a607-9bd3a3db5cf3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUOVWiwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '811276f1-7d8e-4b92-9cb0-239ad4121cff', 'attached_at': '', 'detached_at': '', 'volume_id': '88473f29-16df-48ce-aa93-4488a695edeb', 'serial': '88473f29-16df-48ce-aa93-4488a695edeb'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:08:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUOVWiwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:08:54 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:08:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:08:54 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:08:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:08:54 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:08:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aecda92-121b-4da1-b7bc-0e4fe594ebe8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:08:54 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1f9151-f0eb-4732-971e-733f0112042b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb] added
Aug 27 05:08:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc67fe7-b6d3-4213-ab77-07e3449e6270]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f93a1-2706-46e6-8239-939ccba96a4e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUOVWiwm {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUOVWiwm" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[63452bff-af9f-4312-a6e0-273c2e6c2fd1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUOVWiwm'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8052282d-0242-4171-b0e6-f4e013d88647]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ed6bf-2a72-45c2-945d-9d23a308decf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[de897cfa-1f84-4b74-84ec-b95944080c2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260]
Aug 27 05:08:55 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260] successful.
Aug 27 05:08:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.081s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95363a0-bf95-4249-9282-06523a12e9b3]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d59751b-0b4a-4d60-8aaa-63496a5e6699]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:55 user nova-compute[72904]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:08:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:08:55 user nova-compute[72904]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:08:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d3a4d-a732-453b-9728-6b9b8d3e019d]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:08:55 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUOVWiwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '23435663738323863', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435663738323863', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179411322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179411322',id=22,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-ifzy4j22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:08:35Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=811276f1-7d8e-4b92-9cb0-239ad4121cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'pci_devices' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:08:56 user nova-compute[72904]:   <uuid>811276f1-7d8e-4b92-9cb0-239ad4121cff</uuid>
Aug 27 05:08:56 user nova-compute[72904]:   <name>instance-00000016</name>
Aug 27 05:08:56 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:08:56 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:08:56 user nova-compute[72904]:   <metadata>
Aug 27 05:08:56 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:08:56 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:08:56 user nova-compute[72904]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-179411322</nova:name>
Aug 27 05:08:56 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:08:54</nova:creationTime>
Aug 27 05:08:56 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:08:56 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:08:56 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:08:56 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:08:56 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:08:56 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:08:56 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:08:56 user nova-compute[72904]:       <nova:owner>
Aug 27 05:08:56 user nova-compute[72904]:         <nova:user uuid="f4bbded3a71e4d6196d83c1fa5e7a868">tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member</nova:user>
Aug 27 05:08:56 user nova-compute[72904]:         <nova:project uuid="da9ae29302d54f8aa82e6c51bbfba65d">tempest-ServerBootFromVolumeStableRescueTest-1493340065</nova:project>
Aug 27 05:08:56 user nova-compute[72904]:       </nova:owner>
Aug 27 05:08:56 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:08:56 user nova-compute[72904]:       <nova:ports>
Aug 27 05:08:56 user nova-compute[72904]:         <nova:port uuid="14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6">
Aug 27 05:08:56 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 05:08:56 user nova-compute[72904]:         </nova:port>
Aug 27 05:08:56 user nova-compute[72904]:       </nova:ports>
Aug 27 05:08:56 user nova-compute[72904]:     </nova:instance>
Aug 27 05:08:56 user nova-compute[72904]:   </metadata>
Aug 27 05:08:56 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:08:56 user nova-compute[72904]:     <system>
Aug 27 05:08:56 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:08:56 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:08:56 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:08:56 user nova-compute[72904]:       <entry name="serial">811276f1-7d8e-4b92-9cb0-239ad4121cff</entry>
Aug 27 05:08:56 user nova-compute[72904]:       <entry name="uuid">811276f1-7d8e-4b92-9cb0-239ad4121cff</entry>
Aug 27 05:08:56 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:08:56 user nova-compute[72904]:     </system>
Aug 27 05:08:56 user nova-compute[72904]:   </sysinfo>
Aug 27 05:08:56 user nova-compute[72904]:   <os>
Aug 27 05:08:56 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:08:56 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:08:56 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:08:56 user nova-compute[72904]:   </os>
Aug 27 05:08:56 user nova-compute[72904]:   <features>
Aug 27 05:08:56 user nova-compute[72904]:     <acpi/>
Aug 27 05:08:56 user nova-compute[72904]:     <apic/>
Aug 27 05:08:56 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:08:56 user nova-compute[72904]:   </features>
Aug 27 05:08:56 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:08:56 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:08:56 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:08:56 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:08:56 user nova-compute[72904]:   </clock>
Aug 27 05:08:56 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:08:56 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:08:56 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:08:56 user nova-compute[72904]:   </cpu>
Aug 27 05:08:56 user nova-compute[72904]:   <devices>
Aug 27 05:08:56 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:08:56 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:08:56 user nova-compute[72904]:       <source dev="/dev/sdc"/>
Aug 27 05:08:56 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:08:56 user nova-compute[72904]:       <serial>88473f29-16df-48ce-aa93-4488a695edeb</serial>
Aug 27 05:08:56 user nova-compute[72904]:     </disk>
Aug 27 05:08:56 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:08:56 user nova-compute[72904]:       <mac address="fa:16:3e:31:19:c7"/>
Aug 27 05:08:56 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:56 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:08:56 user nova-compute[72904]:       <target dev="tap14e518d8-3b"/>
Aug 27 05:08:56 user nova-compute[72904]:     </interface>
Aug 27 05:08:56 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:08:56 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/console.log" append="off"/>
Aug 27 05:08:56 user nova-compute[72904]:     </serial>
Aug 27 05:08:56 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:08:56 user nova-compute[72904]:     <video>
Aug 27 05:08:56 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:08:56 user nova-compute[72904]:     </video>
Aug 27 05:08:56 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:08:56 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:08:56 user nova-compute[72904]:     </rng>
Aug 27 05:08:56 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:08:56 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:08:56 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:08:56 user nova-compute[72904]:     </memballoon>
Aug 27 05:08:56 user nova-compute[72904]:   </devices>
Aug 27 05:08:56 user nova-compute[72904]: </domain>
Aug 27 05:08:56 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179411322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179411322',id=22,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-ifzy4j22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:08:35Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=811276f1-7d8e-4b92-9cb0-239ad4121cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG os_vif [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14e518d8-3b, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14e518d8-3b, col_values=(('external_ids', {'iface-id': '14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:19:c7', 'vm-uuid': '811276f1-7d8e-4b92-9cb0-239ad4121cff'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:56 user nova-compute[72904]: INFO os_vif [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b')
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:08:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No VIF found with MAC fa:16:3e:31:19:c7, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-b600eb9a-0014-469a-b658-e44185949bc4 req-7784b751-f939-480d-9706-04f734f40c1a service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b600eb9a-0014-469a-b658-e44185949bc4 req-7784b751-f939-480d-9706-04f734f40c1a service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b600eb9a-0014-469a-b658-e44185949bc4 req-7784b751-f939-480d-9706-04f734f40c1a service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b600eb9a-0014-469a-b658-e44185949bc4 req-7784b751-f939-480d-9706-04f734f40c1a service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:08:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-b600eb9a-0014-469a-b658-e44185949bc4 req-7784b751-f939-480d-9706-04f734f40c1a service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:08:58 user nova-compute[72904]: WARNING nova.compute.manager [req-b600eb9a-0014-469a-b658-e44185949bc4 req-7784b751-f939-480d-9706-04f734f40c1a service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state building and task_state spawning.
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-cb864586-32c0-4072-a8ab-ca224b64fbd3 req-2fcfbb1e-27b7-454e-ae86-b69c81007890 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cb864586-32c0-4072-a8ab-ca224b64fbd3 req-2fcfbb1e-27b7-454e-ae86-b69c81007890 service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cb864586-32c0-4072-a8ab-ca224b64fbd3 req-2fcfbb1e-27b7-454e-ae86-b69c81007890 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cb864586-32c0-4072-a8ab-ca224b64fbd3 req-2fcfbb1e-27b7-454e-ae86-b69c81007890 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-cb864586-32c0-4072-a8ab-ca224b64fbd3 req-2fcfbb1e-27b7-454e-ae86-b69c81007890 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:09:00 user nova-compute[72904]: WARNING nova.compute.manager [req-cb864586-32c0-4072-a8ab-ca224b64fbd3 req-2fcfbb1e-27b7-454e-ae86-b69c81007890 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state building and task_state spawning.
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112940.5558655, 811276f1-7d8e-4b92-9cb0-239ad4121cff => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:09:00 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] VM Resumed (Lifecycle Event)
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:09:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance spawned successfully.
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:09:00 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693112940.557244, 811276f1-7d8e-4b92-9cb0-239ad4121cff => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:09:00 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] VM Started (Lifecycle Event)
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:09:00 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:09:00 user nova-compute[72904]: INFO nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 27 05:09:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:09:00 user nova-compute[72904]: INFO nova.compute.manager [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Took 26.27 seconds to build instance.
Aug 27 05:09:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f8adacbb-28d4-44f1-806c-851f743d64c1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.370s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:09:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:09:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:25 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:09:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:09:30 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=25.650253295898438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:09:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:09:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3b659348-f582-4c6e-8152-57c455e8302e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f8dad8d9-a024-4f25-b1fa-52424b79b662 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.854s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:09:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:33 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:33 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:33 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:09:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:09:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:09:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:09:34 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:09:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:09:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:09:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:09:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:09:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:09:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:09:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:09:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:09:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:55 user nova-compute[72904]: INFO nova.compute.manager [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Rescuing
Aug 27 05:09:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:09:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:09:55 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance destroyed successfully.
Aug 27 05:09:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Attempting rescue
Aug 27 05:09:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72904) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:09:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Creating image(s)
Aug 27 05:09:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'trusted_certs' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:09:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue" returned: 0 in 0.061s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'migration_context' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.base [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<19a548f0-90c2-47bb-8a68-7a788d7d736b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Start _get_guest_xml network_info=[{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:92:42:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'resources' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.base [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<19a548f0-90c2-47bb-8a68-7a788d7d736b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'numa_topology' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.base [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<19a548f0-90c2-47bb-8a68-7a788d7d736b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:09:57 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:09:57 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'vcpu_model' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.base [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<19a548f0-90c2-47bb-8a68-7a788d7d736b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929196508',display_name='tempest-ServerRescueNegativeTestJSON-server-1929196508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929196508',id=16,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-gd8c0sey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:05:19Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=19a548f0-90c2-47bb-8a68-7a788d7d736b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:92:42:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:92:42:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'pci_devices' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.objects.base [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<19a548f0-90c2-47bb-8a68-7a788d7d736b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:09:57 user nova-compute[72904]:   <uuid>19a548f0-90c2-47bb-8a68-7a788d7d736b</uuid>
Aug 27 05:09:57 user nova-compute[72904]:   <name>instance-00000010</name>
Aug 27 05:09:57 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:09:57 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:09:57 user nova-compute[72904]:   <metadata>
Aug 27 05:09:57 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:09:57 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:09:57 user nova-compute[72904]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1929196508</nova:name>
Aug 27 05:09:57 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:09:57</nova:creationTime>
Aug 27 05:09:57 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:09:57 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:09:57 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:09:57 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:09:57 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:09:57 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:09:57 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:09:57 user nova-compute[72904]:       <nova:owner>
Aug 27 05:09:57 user nova-compute[72904]:         <nova:user uuid="223d760d5f03408781a9241f98a5a6c8">tempest-ServerRescueNegativeTestJSON-275121126-project-member</nova:user>
Aug 27 05:09:57 user nova-compute[72904]:         <nova:project uuid="1b16eb565e64463c9a6e61ddcad25728">tempest-ServerRescueNegativeTestJSON-275121126</nova:project>
Aug 27 05:09:57 user nova-compute[72904]:       </nova:owner>
Aug 27 05:09:57 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:09:57 user nova-compute[72904]:       <nova:ports>
Aug 27 05:09:57 user nova-compute[72904]:         <nova:port uuid="9d900a0d-2639-401f-90f9-de3ad2392683">
Aug 27 05:09:57 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 05:09:57 user nova-compute[72904]:         </nova:port>
Aug 27 05:09:57 user nova-compute[72904]:       </nova:ports>
Aug 27 05:09:57 user nova-compute[72904]:     </nova:instance>
Aug 27 05:09:57 user nova-compute[72904]:   </metadata>
Aug 27 05:09:57 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:09:57 user nova-compute[72904]:     <system>
Aug 27 05:09:57 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:09:57 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:09:57 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:09:57 user nova-compute[72904]:       <entry name="serial">19a548f0-90c2-47bb-8a68-7a788d7d736b</entry>
Aug 27 05:09:57 user nova-compute[72904]:       <entry name="uuid">19a548f0-90c2-47bb-8a68-7a788d7d736b</entry>
Aug 27 05:09:57 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:09:57 user nova-compute[72904]:     </system>
Aug 27 05:09:57 user nova-compute[72904]:   </sysinfo>
Aug 27 05:09:57 user nova-compute[72904]:   <os>
Aug 27 05:09:57 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:09:57 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:09:57 user nova-compute[72904]:   </os>
Aug 27 05:09:57 user nova-compute[72904]:   <features>
Aug 27 05:09:57 user nova-compute[72904]:     <acpi/>
Aug 27 05:09:57 user nova-compute[72904]:     <apic/>
Aug 27 05:09:57 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:09:57 user nova-compute[72904]:   </features>
Aug 27 05:09:57 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:09:57 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:09:57 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:09:57 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:09:57 user nova-compute[72904]:   </clock>
Aug 27 05:09:57 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:09:57 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:09:57 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:09:57 user nova-compute[72904]:   </cpu>
Aug 27 05:09:57 user nova-compute[72904]:   <devices>
Aug 27 05:09:57 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:09:57 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:09:57 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue"/>
Aug 27 05:09:57 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:09:57 user nova-compute[72904]:     </disk>
Aug 27 05:09:57 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:09:57 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:09:57 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk"/>
Aug 27 05:09:57 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:09:57 user nova-compute[72904]:     </disk>
Aug 27 05:09:57 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:09:57 user nova-compute[72904]:       <mac address="fa:16:3e:92:42:3e"/>
Aug 27 05:09:57 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:09:57 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:09:57 user nova-compute[72904]:       <target dev="tap9d900a0d-26"/>
Aug 27 05:09:57 user nova-compute[72904]:     </interface>
Aug 27 05:09:57 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:09:57 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/console.log" append="off"/>
Aug 27 05:09:57 user nova-compute[72904]:     </serial>
Aug 27 05:09:57 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:09:57 user nova-compute[72904]:     <video>
Aug 27 05:09:57 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:09:57 user nova-compute[72904]:     </video>
Aug 27 05:09:57 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:09:57 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:09:57 user nova-compute[72904]:     </rng>
Aug 27 05:09:57 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:09:57 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:09:57 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:09:57 user nova-compute[72904]:     </memballoon>
Aug 27 05:09:57 user nova-compute[72904]:   </devices>
Aug 27 05:09:57 user nova-compute[72904]: </domain>
Aug 27 05:09:57 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:09:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance destroyed successfully.
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:09:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No VIF found with MAC fa:16:3e:92:42:3e, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:09:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:09:59 user nova-compute[72904]: INFO nova.compute.claims [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Claim successful on node user
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:09:59 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:09:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG nova.policy [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc32ad60b20c47f6a7790a8d28bb03dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9850ebbdbc8d4081ba11931417e4d96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:10:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Creating image(s)
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "/opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "/opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "/opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "6d518e588337dd8bf360ba0cc54f1c859c86a704" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "6d518e588337dd8bf360ba0cc54f1c859c86a704" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.part --force-share --output=json" returned: 0 in 0.210s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG nova.virt.images [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] 0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0 was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:10:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.part /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Successfully created port: 9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-b64521fc-a33a-4f20-9221-a5426d6e708e req-a65e5e20-8a30-49dd-b3db-f81786247682 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b64521fc-a33a-4f20-9221-a5426d6e708e req-a65e5e20-8a30-49dd-b3db-f81786247682 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b64521fc-a33a-4f20-9221-a5426d6e708e req-a65e5e20-8a30-49dd-b3db-f81786247682 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b64521fc-a33a-4f20-9221-a5426d6e708e req-a65e5e20-8a30-49dd-b3db-f81786247682 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-b64521fc-a33a-4f20-9221-a5426d6e708e req-a65e5e20-8a30-49dd-b3db-f81786247682 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:01 user nova-compute[72904]: WARNING nova.compute.manager [req-b64521fc-a33a-4f20-9221-a5426d6e708e req-a65e5e20-8a30-49dd-b3db-f81786247682 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state active and task_state rescuing.
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.part /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.converted" returned: 0 in 0.454s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 19a548f0-90c2-47bb-8a68-7a788d7d736b due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113001.3965294, 19a548f0-90c2-47bb-8a68-7a788d7d736b => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:01 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] VM Resumed (Lifecycle Event)
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dfffb916-6628-4b4b-97b9-7a167986450a tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:01 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113001.4001853, 19a548f0-90c2-47bb-8a68-7a788d7d736b => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:01 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] VM Started (Lifecycle Event)
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "6d518e588337dd8bf360ba0cc54f1c859c86a704" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.399s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "6d518e588337dd8bf360ba0cc54f1c859c86a704" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "6d518e588337dd8bf360ba0cc54f1c859c86a704" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json" returned: 0 in 0.234s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704,backing_fmt=raw /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704,backing_fmt=raw /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk 1073741824" returned: 0 in 0.067s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "6d518e588337dd8bf360ba0cc54f1c859c86a704" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json" returned: 0 in 0.265s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Cannot resize image /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Ensure instance console log exists: /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Successfully updated port: 9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquired lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Releasing lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance network_info: |[{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Start _get_guest_xml network_info=[{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T05:09:56Z,direct_url=<?>,disk_format='qcow2',id=0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0,min_disk=0,min_ram=0,name='tempest-scenario-img--1061008766',owner='9850ebbdbc8d4081ba11931417e4d96b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T05:09:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:10:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T05:09:56Z,direct_url=<?>,disk_format='qcow2',id=0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0,min_disk=0,min_ram=0,name='tempest-scenario-img--1061008766',owner='9850ebbdbc8d4081ba11931417e4d96b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T05:09:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-154298842',display_name='tempest-TestMinimumBasicScenario-server-154298842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-154298842',id=24,image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmC2e4T98duKpEp83AKEXonLXloh9t/Zb4XOyE6f2eNex/52u+CTWLoC4QbEk/hmnUlfYO/JWFIvfdStE4ntnvvJR4gBuBWUix8fpcaPWlkcm+9eIqAhKBstI+lWg7Cnw==',key_name='tempest-TestMinimumBasicScenario-1793810962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-09cesfte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:10:00Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=12852d71-dd0e-46da-8b7b-674551d62f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'pci_devices' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:03 user nova-compute[72904]: WARNING nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state rescued and task_state None.
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:03 user nova-compute[72904]: WARNING nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state rescued and task_state None.
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:03 user nova-compute[72904]: WARNING nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state rescued and task_state None.
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing instance network info cache due to event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Acquiring lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Acquired lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:10:03 user nova-compute[72904]:   <uuid>12852d71-dd0e-46da-8b7b-674551d62f3c</uuid>
Aug 27 05:10:03 user nova-compute[72904]:   <name>instance-00000018</name>
Aug 27 05:10:03 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:10:03 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:10:03 user nova-compute[72904]:   <metadata>
Aug 27 05:10:03 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:10:03 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:10:03 user nova-compute[72904]:       <nova:name>tempest-TestMinimumBasicScenario-server-154298842</nova:name>
Aug 27 05:10:03 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:10:03</nova:creationTime>
Aug 27 05:10:03 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:10:03 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:10:03 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:10:03 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:10:03 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:10:03 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:10:03 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:10:03 user nova-compute[72904]:       <nova:owner>
Aug 27 05:10:03 user nova-compute[72904]:         <nova:user uuid="bc32ad60b20c47f6a7790a8d28bb03dc">tempest-TestMinimumBasicScenario-216754606-project-member</nova:user>
Aug 27 05:10:03 user nova-compute[72904]:         <nova:project uuid="9850ebbdbc8d4081ba11931417e4d96b">tempest-TestMinimumBasicScenario-216754606</nova:project>
Aug 27 05:10:03 user nova-compute[72904]:       </nova:owner>
Aug 27 05:10:03 user nova-compute[72904]:       <nova:root type="image" uuid="0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0"/>
Aug 27 05:10:03 user nova-compute[72904]:       <nova:ports>
Aug 27 05:10:03 user nova-compute[72904]:         <nova:port uuid="9a8c4683-4885-4a6e-8832-bf0bb7d96111">
Aug 27 05:10:03 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 05:10:03 user nova-compute[72904]:         </nova:port>
Aug 27 05:10:03 user nova-compute[72904]:       </nova:ports>
Aug 27 05:10:03 user nova-compute[72904]:     </nova:instance>
Aug 27 05:10:03 user nova-compute[72904]:   </metadata>
Aug 27 05:10:03 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:10:03 user nova-compute[72904]:     <system>
Aug 27 05:10:03 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:10:03 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:10:03 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:10:03 user nova-compute[72904]:       <entry name="serial">12852d71-dd0e-46da-8b7b-674551d62f3c</entry>
Aug 27 05:10:03 user nova-compute[72904]:       <entry name="uuid">12852d71-dd0e-46da-8b7b-674551d62f3c</entry>
Aug 27 05:10:03 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:10:03 user nova-compute[72904]:     </system>
Aug 27 05:10:03 user nova-compute[72904]:   </sysinfo>
Aug 27 05:10:03 user nova-compute[72904]:   <os>
Aug 27 05:10:03 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:10:03 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:10:03 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:10:03 user nova-compute[72904]:   </os>
Aug 27 05:10:03 user nova-compute[72904]:   <features>
Aug 27 05:10:03 user nova-compute[72904]:     <acpi/>
Aug 27 05:10:03 user nova-compute[72904]:     <apic/>
Aug 27 05:10:03 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:10:03 user nova-compute[72904]:   </features>
Aug 27 05:10:03 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:10:03 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:10:03 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:10:03 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:10:03 user nova-compute[72904]:   </clock>
Aug 27 05:10:03 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:10:03 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:10:03 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:10:03 user nova-compute[72904]:   </cpu>
Aug 27 05:10:03 user nova-compute[72904]:   <devices>
Aug 27 05:10:03 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:10:03 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:10:03 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk"/>
Aug 27 05:10:03 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:10:03 user nova-compute[72904]:     </disk>
Aug 27 05:10:03 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:10:03 user nova-compute[72904]:       <mac address="fa:16:3e:4f:23:09"/>
Aug 27 05:10:03 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:10:03 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:10:03 user nova-compute[72904]:       <target dev="tap9a8c4683-48"/>
Aug 27 05:10:03 user nova-compute[72904]:     </interface>
Aug 27 05:10:03 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:10:03 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/console.log" append="off"/>
Aug 27 05:10:03 user nova-compute[72904]:     </serial>
Aug 27 05:10:03 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:10:03 user nova-compute[72904]:     <video>
Aug 27 05:10:03 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:10:03 user nova-compute[72904]:     </video>
Aug 27 05:10:03 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:10:03 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:10:03 user nova-compute[72904]:     </rng>
Aug 27 05:10:03 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:10:03 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:10:03 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:10:03 user nova-compute[72904]:     </memballoon>
Aug 27 05:10:03 user nova-compute[72904]:   </devices>
Aug 27 05:10:03 user nova-compute[72904]: </domain>
Aug 27 05:10:03 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-154298842',display_name='tempest-TestMinimumBasicScenario-server-154298842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-154298842',id=24,image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmC2e4T98duKpEp83AKEXonLXloh9t/Zb4XOyE6f2eNex/52u+CTWLoC4QbEk/hmnUlfYO/JWFIvfdStE4ntnvvJR4gBuBWUix8fpcaPWlkcm+9eIqAhKBstI+lWg7Cnw==',key_name='tempest-TestMinimumBasicScenario-1793810962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-09cesfte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:10:00Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=12852d71-dd0e-46da-8b7b-674551d62f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG os_vif [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a8c4683-48, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a8c4683-48, col_values=(('external_ids', {'iface-id': '9a8c4683-4885-4a6e-8832-bf0bb7d96111', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:23:09', 'vm-uuid': '12852d71-dd0e-46da-8b7b-674551d62f3c'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:03 user nova-compute[72904]: INFO os_vif [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48')
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:10:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No VIF found with MAC fa:16:3e:4f:23:09, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:10:04 user nova-compute[72904]: DEBUG nova.network.neutron [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updated VIF entry in instance network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:10:04 user nova-compute[72904]: DEBUG nova.network.neutron [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e6f0fdd-911a-46bc-ad14-5bc03d8c6d81 req-cf49e592-5359-4e7a-82bb-91f1289469e6 service nova] Releasing lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-6dc497ec-2fc5-4934-a696-7e801216856c req-1fc802a5-27a7-4338-b08b-acbf9994f337 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6dc497ec-2fc5-4934-a696-7e801216856c req-1fc802a5-27a7-4338-b08b-acbf9994f337 service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6dc497ec-2fc5-4934-a696-7e801216856c req-1fc802a5-27a7-4338-b08b-acbf9994f337 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6dc497ec-2fc5-4934-a696-7e801216856c req-1fc802a5-27a7-4338-b08b-acbf9994f337 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-6dc497ec-2fc5-4934-a696-7e801216856c req-1fc802a5-27a7-4338-b08b-acbf9994f337 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:05 user nova-compute[72904]: WARNING nova.compute.manager [req-6dc497ec-2fc5-4934-a696-7e801216856c req-1fc802a5-27a7-4338-b08b-acbf9994f337 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received unexpected event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with vm_state building and task_state spawning.
Aug 27 05:10:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "3b659348-f582-4c6e-8152-57c455e8302e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "3b659348-f582-4c6e-8152-57c455e8302e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "3b659348-f582-4c6e-8152-57c455e8302e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:07 user nova-compute[72904]: INFO nova.compute.manager [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Terminating instance
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113007.7213824, 12852d71-dd0e-46da-8b7b-674551d62f3c => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] VM Resumed (Lifecycle Event)
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:10:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance spawned successfully.
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-a4b9e323-9f30-4dbd-840a-add673d276c4 req-bb36cb5d-fdc9-463d-a811-96d9986796b7 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a4b9e323-9f30-4dbd-840a-add673d276c4 req-bb36cb5d-fdc9-463d-a811-96d9986796b7 service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a4b9e323-9f30-4dbd-840a-add673d276c4 req-bb36cb5d-fdc9-463d-a811-96d9986796b7 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a4b9e323-9f30-4dbd-840a-add673d276c4 req-bb36cb5d-fdc9-463d-a811-96d9986796b7 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-a4b9e323-9f30-4dbd-840a-add673d276c4 req-bb36cb5d-fdc9-463d-a811-96d9986796b7 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:07 user nova-compute[72904]: WARNING nova.compute.manager [req-a4b9e323-9f30-4dbd-840a-add673d276c4 req-bb36cb5d-fdc9-463d-a811-96d9986796b7 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received unexpected event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with vm_state building and task_state spawning.
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-f8f388bc-0595-4ff1-89d8-400f1e547a4d req-19add05b-af8e-4759-a4dc-e409bfa42779 service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received event network-vif-unplugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f8f388bc-0595-4ff1-89d8-400f1e547a4d req-19add05b-af8e-4759-a4dc-e409bfa42779 service nova] Acquiring lock "3b659348-f582-4c6e-8152-57c455e8302e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f8f388bc-0595-4ff1-89d8-400f1e547a4d req-19add05b-af8e-4759-a4dc-e409bfa42779 service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f8f388bc-0595-4ff1-89d8-400f1e547a4d req-19add05b-af8e-4759-a4dc-e409bfa42779 service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-f8f388bc-0595-4ff1-89d8-400f1e547a4d req-19add05b-af8e-4759-a4dc-e409bfa42779 service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] No waiting events found dispatching network-vif-unplugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-f8f388bc-0595-4ff1-89d8-400f1e547a4d req-19add05b-af8e-4759-a4dc-e409bfa42779 service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received event network-vif-unplugged-d75fc875-8da3-4605-8630-1f71f91aad5c for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113007.7225478, 12852d71-dd0e-46da-8b7b-674551d62f3c => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] VM Started (Lifecycle Event)
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:07 user nova-compute[72904]: INFO nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 27 05:10:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:10:08 user nova-compute[72904]: INFO nova.compute.manager [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Took 8.65 seconds to build instance.
Aug 27 05:10:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b09bc41c-a52a-45f5-8069-0e5ee20034c8 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.769s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Instance destroyed successfully.
Aug 27 05:10:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lazy-loading 'resources' on Instance uuid 3b659348-f582-4c6e-8152-57c455e8302e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1153422703',display_name='tempest-VolumesActionsTest-instance-1153422703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1153422703',id=21,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d44a21df639749929efe405de33b9718',ramdisk_id='',reservation_id='r-14nrg9tr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1180339496',owner_user_name='tempest-VolumesActionsTest-1180339496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:08:24Z,user_data=None,user_id='a96642953830474a968fbb0a4e21aaaf',uuid=3b659348-f582-4c6e-8152-57c455e8302e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converting VIF {"id": "d75fc875-8da3-4605-8630-1f71f91aad5c", "address": "fa:16:3e:a3:f1:48", "network": {"id": "6a5a49e1-cb1b-42aa-a8e4-f11829a46399", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374522632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d44a21df639749929efe405de33b9718", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd75fc875-8d", "ovs_interfaceid": "d75fc875-8da3-4605-8630-1f71f91aad5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=d75fc875-8da3-4605-8630-1f71f91aad5c,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75fc875-8d') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG os_vif [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=d75fc875-8da3-4605-8630-1f71f91aad5c,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75fc875-8d') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd75fc875-8d, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:10:08 user nova-compute[72904]: INFO os_vif [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=d75fc875-8da3-4605-8630-1f71f91aad5c,network=Network(6a5a49e1-cb1b-42aa-a8e4-f11829a46399),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd75fc875-8d')
Aug 27 05:10:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Deleting instance files /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e_del
Aug 27 05:10:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Deletion of /opt/stack/data/nova/instances/3b659348-f582-4c6e-8152-57c455e8302e_del complete
Aug 27 05:10:08 user nova-compute[72904]: INFO nova.compute.manager [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 27 05:10:08 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:10:08 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:09 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Took 0.76 seconds to deallocate network for instance.
Aug 27 05:10:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:09 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Deleted allocations for instance 3b659348-f582-4c6e-8152-57c455e8302e
Aug 27 05:10:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-332d0331-0531-4e24-b0a6-68cf8bd4a9d9 tempest-VolumesActionsTest-1180339496 tempest-VolumesActionsTest-1180339496-project-member] Lock "3b659348-f582-4c6e-8152-57c455e8302e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-51fdb6a2-b6bd-4a4d-aa9a-42f04c2c5711 req-1076a737-acd4-4161-a592-da898a6a60d7 service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received event network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-51fdb6a2-b6bd-4a4d-aa9a-42f04c2c5711 req-1076a737-acd4-4161-a592-da898a6a60d7 service nova] Acquiring lock "3b659348-f582-4c6e-8152-57c455e8302e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-51fdb6a2-b6bd-4a4d-aa9a-42f04c2c5711 req-1076a737-acd4-4161-a592-da898a6a60d7 service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-51fdb6a2-b6bd-4a4d-aa9a-42f04c2c5711 req-1076a737-acd4-4161-a592-da898a6a60d7 service nova] Lock "3b659348-f582-4c6e-8152-57c455e8302e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-51fdb6a2-b6bd-4a4d-aa9a-42f04c2c5711 req-1076a737-acd4-4161-a592-da898a6a60d7 service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] No waiting events found dispatching network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:09 user nova-compute[72904]: WARNING nova.compute.manager [req-51fdb6a2-b6bd-4a4d-aa9a-42f04c2c5711 req-1076a737-acd4-4161-a592-da898a6a60d7 service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received unexpected event network-vif-plugged-d75fc875-8da3-4605-8630-1f71f91aad5c for instance with vm_state deleted and task_state None.
Aug 27 05:10:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-51fdb6a2-b6bd-4a4d-aa9a-42f04c2c5711 req-1076a737-acd4-4161-a592-da898a6a60d7 service nova] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Received event network-vif-deleted-d75fc875-8da3-4605-8630-1f71f91aad5c {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:10 user nova-compute[72904]: INFO nova.compute.manager [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Detaching volume 222fb851-f74c-4c2f-a2fb-70878da61f9f
Aug 27 05:10:10 user nova-compute[72904]: INFO nova.virt.block_device [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Attempting to driver detach volume 222fb851-f74c-4c2f-a2fb-70878da61f9f from mountpoint /dev/vdb
Aug 27 05:10:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Attempting to detach device vdb from instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:10:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:10:10 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:10:10 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:10:10 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:10:10 user nova-compute[72904]:   <serial>222fb851-f74c-4c2f-a2fb-70878da61f9f</serial>
Aug 27 05:10:10 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:10:10 user nova-compute[72904]: </disk>
Aug 27 05:10:10 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:10:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully detached device vdb from instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca from the persistent domain config.
Aug 27 05:10:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:10:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:10:10 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:10:10 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:10:10 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:10:10 user nova-compute[72904]:   <serial>222fb851-f74c-4c2f-a2fb-70878da61f9f</serial>
Aug 27 05:10:10 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:10:10 user nova-compute[72904]: </disk>
Aug 27 05:10:10 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113011.4531257, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:10:11 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully detached device vdb from instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca from the live domain config.
Aug 27 05:10:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MgbdVSzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:10:11 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e3066-1af9-46fe-a7c2-217510979d67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[941b5876-21d1-4088-a59a-6130f3a981d6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:10:11 user nova-compute[72904]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:10:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f (non-flash)
Aug 27 05:10:11 user nova-compute[72904]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:10:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c6b5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d11d218-2afa-4635-bb63-2f486d88c8d1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee70e93-46e7-4474-802e-4d79456b5e05]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edffc94-df87-4ec5-8ff1-f2e971299291]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeb4539-b48e-4aea-875b-ba5c37fc8a6c]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f31cf6-fe38-45a6-a2f2-3cca13ced5a5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6eb7c1-5c68-490a-bb2c-ed399b302d3a]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260]
Aug 27 05:10:11 user nova-compute[72904]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f, portal: 172.16.0.220,3260] successful.
Aug 27 05:10:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222fb851-f74c-4c2f-a2fb-70878da61f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac413fd3-60a2-4d84-ab24-fa07ef2d74ab]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== disconnect_volume: return (321ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:10:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:10:12 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6739e1c9-db56-4810-816a-e5ab382bb861 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.913s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c8c02df4-38f6-4d67-be5e-263dfc4dc12d tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c8c02df4-38f6-4d67-be5e-263dfc4dc12d tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c8c02df4-38f6-4d67-be5e-263dfc4dc12d tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c8c02df4-38f6-4d67-be5e-263dfc4dc12d tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72904) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c8c02df4-38f6-4d67-be5e-263dfc4dc12d tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-c3725165-4e4c-422e-b691-14309b0558b2 req-cc640ea4-97c0-4b87-84ef-fd08d37cd3c9 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c3725165-4e4c-422e-b691-14309b0558b2 req-cc640ea4-97c0-4b87-84ef-fd08d37cd3c9 service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c3725165-4e4c-422e-b691-14309b0558b2 req-cc640ea4-97c0-4b87-84ef-fd08d37cd3c9 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c3725165-4e4c-422e-b691-14309b0558b2 req-cc640ea4-97c0-4b87-84ef-fd08d37cd3c9 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-c3725165-4e4c-422e-b691-14309b0558b2 req-cc640ea4-97c0-4b87-84ef-fd08d37cd3c9 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:13 user nova-compute[72904]: WARNING nova.compute.manager [req-c3725165-4e4c-422e-b691-14309b0558b2 req-cc640ea4-97c0-4b87-84ef-fd08d37cd3c9 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state active and task_state powering-off.
Aug 27 05:10:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance destroyed successfully.
Aug 27 05:10:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c8c02df4-38f6-4d67-be5e-263dfc4dc12d tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c8c02df4-38f6-4d67-be5e-263dfc4dc12d tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.957s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-61210942-165b-4d8f-9718-55415278b2ab req-a5f9705f-22f2-4f7c-ab20-3953d82ea975 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-61210942-165b-4d8f-9718-55415278b2ab req-a5f9705f-22f2-4f7c-ab20-3953d82ea975 service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-61210942-165b-4d8f-9718-55415278b2ab req-a5f9705f-22f2-4f7c-ab20-3953d82ea975 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-61210942-165b-4d8f-9718-55415278b2ab req-a5f9705f-22f2-4f7c-ab20-3953d82ea975 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-61210942-165b-4d8f-9718-55415278b2ab req-a5f9705f-22f2-4f7c-ab20-3953d82ea975 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:15 user nova-compute[72904]: WARNING nova.compute.manager [req-61210942-165b-4d8f-9718-55415278b2ab req-a5f9705f-22f2-4f7c-ab20-3953d82ea975 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state stopped and task_state None.
Aug 27 05:10:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113008.265391, 3b659348-f582-4c6e-8152-57c455e8302e => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:23 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] VM Stopped (Lifecycle Event)
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:10:23 user nova-compute[72904]: INFO nova.compute.claims [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Claim successful on node user
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b7c158ec-a833-44e8-a077-13203807627c None None] [instance: 3b659348-f582-4c6e-8152-57c455e8302e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:10:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.policy [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14df3bfebe7c43dca0a4ef2ee90f995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553916b16f8404ca042ad82b503e6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:10:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Creating image(s)
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.237s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk 1073741824" returned: 0 in 0.071s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:24 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Successfully created port: 22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Cannot resize image /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Ensure instance console log exists: /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:25 user nova-compute[72904]: INFO nova.compute.manager [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Rescuing
Aug 27 05:10:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG nova.network.neutron [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Successfully updated port: 22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquired lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-changed-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Refreshing instance network info cache due to event network-changed-22f4c3df-638a-45cd-8f21-adfe33f65c1a. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] Acquiring lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-7546a100-d668-4b1c-b4ee-3ee9986cca89 req-1aa50f8a-0d51-472e-a9e0-fb225e6306b3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-unplugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7546a100-d668-4b1c-b4ee-3ee9986cca89 req-1aa50f8a-0d51-472e-a9e0-fb225e6306b3 service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7546a100-d668-4b1c-b4ee-3ee9986cca89 req-1aa50f8a-0d51-472e-a9e0-fb225e6306b3 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7546a100-d668-4b1c-b4ee-3ee9986cca89 req-1aa50f8a-0d51-472e-a9e0-fb225e6306b3 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-7546a100-d668-4b1c-b4ee-3ee9986cca89 req-1aa50f8a-0d51-472e-a9e0-fb225e6306b3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-unplugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:27 user nova-compute[72904]: WARNING nova.compute.manager [req-7546a100-d668-4b1c-b4ee-3ee9986cca89 req-1aa50f8a-0d51-472e-a9e0-fb225e6306b3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-unplugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state active and task_state rescuing.
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updating instance_info_cache with network_info: [{"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Releasing lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance network_info: |[{"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] Acquired lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.neutron [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Refreshing network info cache for port 22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Start _get_guest_xml network_info=[{"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:10:27 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:27 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1345860853',display_name='tempest-tempest.common.compute-instance-1345860853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1345860853',id=25,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++BiDN+mUiQdqNo4heN++I25Vk6uDCgkOxauU/iskeWbKK2dvwTPa++12IJ1pqvVfHSF/xobaW93KJ6Uqd5KTLkpkHWhOW9ylpRKGUXozXUiC4bSWMwZQerq2l/iY7og==',key_name='tempest-keypair-1714509772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-mk08pdxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:10:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=e8403a20-3d6b-4897-b697-fdb1e7722e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'pci_devices' on Instance uuid e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:10:27 user nova-compute[72904]:   <uuid>e8403a20-3d6b-4897-b697-fdb1e7722e4f</uuid>
Aug 27 05:10:27 user nova-compute[72904]:   <name>instance-00000019</name>
Aug 27 05:10:27 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:10:27 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:10:27 user nova-compute[72904]:   <metadata>
Aug 27 05:10:27 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:10:27 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:10:27 user nova-compute[72904]:       <nova:name>tempest-tempest.common.compute-instance-1345860853</nova:name>
Aug 27 05:10:27 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:10:27</nova:creationTime>
Aug 27 05:10:27 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:10:27 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:10:27 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:10:27 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:10:27 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:10:27 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:10:27 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:10:27 user nova-compute[72904]:       <nova:owner>
Aug 27 05:10:27 user nova-compute[72904]:         <nova:user uuid="14df3bfebe7c43dca0a4ef2ee90f995b">tempest-ServerActionsTestOtherA-886850923-project-member</nova:user>
Aug 27 05:10:27 user nova-compute[72904]:         <nova:project uuid="a553916b16f8404ca042ad82b503e6c7">tempest-ServerActionsTestOtherA-886850923</nova:project>
Aug 27 05:10:27 user nova-compute[72904]:       </nova:owner>
Aug 27 05:10:27 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:10:27 user nova-compute[72904]:       <nova:ports>
Aug 27 05:10:27 user nova-compute[72904]:         <nova:port uuid="22f4c3df-638a-45cd-8f21-adfe33f65c1a">
Aug 27 05:10:27 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 05:10:27 user nova-compute[72904]:         </nova:port>
Aug 27 05:10:27 user nova-compute[72904]:       </nova:ports>
Aug 27 05:10:27 user nova-compute[72904]:     </nova:instance>
Aug 27 05:10:27 user nova-compute[72904]:   </metadata>
Aug 27 05:10:27 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:10:27 user nova-compute[72904]:     <system>
Aug 27 05:10:27 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:10:27 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:10:27 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:10:27 user nova-compute[72904]:       <entry name="serial">e8403a20-3d6b-4897-b697-fdb1e7722e4f</entry>
Aug 27 05:10:27 user nova-compute[72904]:       <entry name="uuid">e8403a20-3d6b-4897-b697-fdb1e7722e4f</entry>
Aug 27 05:10:27 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:10:27 user nova-compute[72904]:     </system>
Aug 27 05:10:27 user nova-compute[72904]:   </sysinfo>
Aug 27 05:10:27 user nova-compute[72904]:   <os>
Aug 27 05:10:27 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:10:27 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:10:27 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:10:27 user nova-compute[72904]:   </os>
Aug 27 05:10:27 user nova-compute[72904]:   <features>
Aug 27 05:10:27 user nova-compute[72904]:     <acpi/>
Aug 27 05:10:27 user nova-compute[72904]:     <apic/>
Aug 27 05:10:27 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:10:27 user nova-compute[72904]:   </features>
Aug 27 05:10:27 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:10:27 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:10:27 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:10:27 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:10:27 user nova-compute[72904]:   </clock>
Aug 27 05:10:27 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:10:27 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:10:27 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:10:27 user nova-compute[72904]:   </cpu>
Aug 27 05:10:27 user nova-compute[72904]:   <devices>
Aug 27 05:10:27 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:10:27 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:10:27 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk"/>
Aug 27 05:10:27 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:10:27 user nova-compute[72904]:     </disk>
Aug 27 05:10:27 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:10:27 user nova-compute[72904]:       <mac address="fa:16:3e:af:c5:7b"/>
Aug 27 05:10:27 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:10:27 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:10:27 user nova-compute[72904]:       <target dev="tap22f4c3df-63"/>
Aug 27 05:10:27 user nova-compute[72904]:     </interface>
Aug 27 05:10:27 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:10:27 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/console.log" append="off"/>
Aug 27 05:10:27 user nova-compute[72904]:     </serial>
Aug 27 05:10:27 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:10:27 user nova-compute[72904]:     <video>
Aug 27 05:10:27 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:10:27 user nova-compute[72904]:     </video>
Aug 27 05:10:27 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:10:27 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:10:27 user nova-compute[72904]:     </rng>
Aug 27 05:10:27 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:10:27 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:10:27 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:10:27 user nova-compute[72904]:     </memballoon>
Aug 27 05:10:27 user nova-compute[72904]:   </devices>
Aug 27 05:10:27 user nova-compute[72904]: </domain>
Aug 27 05:10:27 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1345860853',display_name='tempest-tempest.common.compute-instance-1345860853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1345860853',id=25,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++BiDN+mUiQdqNo4heN++I25Vk6uDCgkOxauU/iskeWbKK2dvwTPa++12IJ1pqvVfHSF/xobaW93KJ6Uqd5KTLkpkHWhOW9ylpRKGUXozXUiC4bSWMwZQerq2l/iY7og==',key_name='tempest-keypair-1714509772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-mk08pdxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:10:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=e8403a20-3d6b-4897-b697-fdb1e7722e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG os_vif [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22f4c3df-63, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22f4c3df-63, col_values=(('external_ids', {'iface-id': '22f4c3df-638a-45cd-8f21-adfe33f65c1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:c5:7b', 'vm-uuid': 'e8403a20-3d6b-4897-b697-fdb1e7722e4f'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:10:27 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance destroyed successfully.
Aug 27 05:10:27 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Attempting a stable device rescue
Aug 27 05:10:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:27 user nova-compute[72904]: INFO os_vif [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63')
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72904) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:10:27 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Creating image(s)
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "/opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.objects.instance [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'trusted_certs' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:10:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No VIF found with MAC fa:16:3e:af:c5:7b, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:10:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113013.9926078, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:29 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Stopped (Lifecycle Event)
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-806682ce-259f-4d91-a876-47f099384b93 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-806682ce-259f-4d91-a876-47f099384b93 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.part --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.virt.images [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] c48f9f95-fe06-4ef2-aefd-642f16c180ea was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.part /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-87930bf8-654a-4d50-bf69-1d957f62ed47 req-780d8964-2664-4ea3-8738-16af4c58b469 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-87930bf8-654a-4d50-bf69-1d957f62ed47 req-780d8964-2664-4ea3-8738-16af4c58b469 service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-87930bf8-654a-4d50-bf69-1d957f62ed47 req-780d8964-2664-4ea3-8738-16af4c58b469 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-87930bf8-654a-4d50-bf69-1d957f62ed47 req-780d8964-2664-4ea3-8738-16af4c58b469 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-87930bf8-654a-4d50-bf69-1d957f62ed47 req-780d8964-2664-4ea3-8738-16af4c58b469 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:29 user nova-compute[72904]: WARNING nova.compute.manager [req-87930bf8-654a-4d50-bf69-1d957f62ed47 req-780d8964-2664-4ea3-8738-16af4c58b469 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state active and task_state rescuing.
Aug 27 05:10:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updated VIF entry in instance network info cache for port 22f4c3df-638a-45cd-8f21-adfe33f65c1a. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updating instance_info_cache with network_info: [{"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0779eeb6-f755-4d73-8c13-a1484a956ebb req-b2ba7b0c-3d0e-4d3e-8132-eea76ff4201e service nova] Releasing lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.part /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.converted" returned: 0 in 0.272s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-0adae56b-bb06-430c-ac86-37714968722e req-b1e450a8-1372-42e3-904d-17258b053942 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0adae56b-bb06-430c-ac86-37714968722e req-b1e450a8-1372-42e3-904d-17258b053942 service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0adae56b-bb06-430c-ac86-37714968722e req-b1e450a8-1372-42e3-904d-17258b053942 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0adae56b-bb06-430c-ac86-37714968722e req-b1e450a8-1372-42e3-904d-17258b053942 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-0adae56b-bb06-430c-ac86-37714968722e req-b1e450a8-1372-42e3-904d-17258b053942 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:29 user nova-compute[72904]: WARNING nova.compute.manager [req-0adae56b-bb06-430c-ac86-37714968722e req-b1e450a8-1372-42e3-904d-17258b053942 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received unexpected event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with vm_state building and task_state spawning.
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.805s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905 --force-share --output=json" returned: 0 in 0.235s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905,backing_fmt=raw /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905,backing_fmt=raw /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue" returned: 0 in 0.055s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.objects.instance [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'migration_context' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.objects.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<811276f1-7d8e-4b92-9cb0-239ad4121cff> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Start _get_guest_xml network_info=[{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "vif_mac": "fa:16:3e:31:19:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c48f9f95-fe06-4ef2-aefd-642f16c180ea', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3cb0b045-b030-4a56-a607-9bd3a3db5cf3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUOVWiwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '811276f1-7d8e-4b92-9cb0-239ad4121cff', 'attached_at': '', 'detached_at': '', 'volume_id': '88473f29-16df-48ce-aa93-4488a695edeb', 'serial': '88473f29-16df-48ce-aa93-4488a695edeb'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.objects.instance [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'resources' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.objects.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<811276f1-7d8e-4b92-9cb0-239ad4121cff> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:10:29 user nova-compute[72904]: DEBUG nova.objects.instance [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'numa_topology' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.objects.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<811276f1-7d8e-4b92-9cb0-239ad4121cff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:10:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.objects.instance [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'vcpu_model' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.objects.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<811276f1-7d8e-4b92-9cb0-239ad4121cff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUOVWiwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:10:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:10:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:10:30 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:10:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a81aa8-2449-4b4c-bf14-6eb1bc4e8d63]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PUOVWiwm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 05:10:30 user nova-compute[72904]: node.name = iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb
Aug 27 05:10:30 user nova-compute[72904]: node.tpgt = -1
Aug 27 05:10:30 user nova-compute[72904]: node.startup = automatic
Aug 27 05:10:30 user nova-compute[72904]: node.leading_login = No
Aug 27 05:10:30 user nova-compute[72904]: iface.iscsi_ifacename = default
Aug 27 05:10:30 user nova-compute[72904]: iface.net_ifacename = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.ipaddress = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.prefix_len = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.hwaddress = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.transport_name = tcp
Aug 27 05:10:30 user nova-compute[72904]: iface.initiatorname = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.state = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.vlan_id = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.vlan_priority = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.vlan_state = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.iface_num = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.mtu = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.port = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.bootproto = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.subnet_mask = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.gateway = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_alt_client_id = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_dns = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_learn_iqn = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_vendor_id_state = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_vendor_id = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.dhcp_slp_da = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.fragmentation = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.gratuitous_arp = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.incoming_forwarding = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.tos_state = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.tos = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.ttl = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.delayed_ack = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.tcp_nagle = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.tcp_wsf_state = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.tcp_wsf = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.tcp_timer_scale = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.tcp_timestamp = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.redirect = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.def_task_mgmt_timeout = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.header_digest = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.data_digest = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.immediate_data = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.initial_r2t = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.data_seq_inorder = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.data_pdu_inorder = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.erl = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.max_receive_data_len = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.first_burst_len = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.max_outstanding_r2t = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.max_burst_len = 0
Aug 27 05:10:30 user nova-compute[72904]: iface.chap_auth = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.bidi_chap = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.strict_login_compliance = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.discovery_auth = <empty>
Aug 27 05:10:30 user nova-compute[72904]: iface.discovery_logout = <empty>
Aug 27 05:10:30 user nova-compute[72904]: node.discovery_address = <empty>
Aug 27 05:10:30 user nova-compute[72904]: node.discovery_port = 0
Aug 27 05:10:30 user nova-compute[72904]: node.discovery_type = static
Aug 27 05:10:30 user nova-compute[72904]: node.session.initial_cmdsn = 0
Aug 27 05:10:30 user nova-compute[72904]: node.session.initial_login_retry_max = 8
Aug 27 05:10:30 user nova-compute[72904]: node.session.xmit_thread_priority = -20
Aug 27 05:10:30 user nova-compute[72904]: node.session.cmds_max = 128
Aug 27 05:10:30 user nova-compute[72904]: node.session.queue_depth = 32
Aug 27 05:10:30 user nova-compute[72904]: node.session.nr_sessions = 1
Aug 27 05:10:30 user nova-compute[72904]: node.session.auth.authmethod = CHAP
Aug 27 05:10:30 user nova-compute[72904]: node.session.auth.username = PUOVWiwm
Aug 27 05:10:30 user nova-compute[72904]: node.session.auth.password = ***
Aug 27 05:10:30 user nova-compute[72904]: node.session.auth.username_in = <empty>
Aug 27 05:10:30 user nova-compute[72904]: node.session.auth.password_in = <empty>
Aug 27 05:10:30 user nova-compute[72904]: node.session.auth.chap_algs = MD5
Aug 27 05:10:30 user nova-compute[72904]: node.session.timeo.replacement_timeout = 120
Aug 27 05:10:30 user nova-compute[72904]: node.session.err_timeo.abort_timeout = 15
Aug 27 05:10:30 user nova-compute[72904]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 05:10:30 user nova-compute[72904]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 05:10:30 user nova-compute[72904]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.FastAbort = Yes
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.InitialR2T = No
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.ImmediateData = Yes
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.MaxConnections = 1
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 05:10:30 user nova-compute[72904]: node.session.iscsi.ERL = 0
Aug 27 05:10:30 user nova-compute[72904]: node.session.scan = manual
Aug 27 05:10:30 user nova-compute[72904]: node.session.reopen_max = 0
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].address = 172.16.0.220
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].port = 3260
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].startup = manual
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].tcp.window_size = 524288
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].tcp.type_of_service = 0
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].timeo.logout_timeout = 15
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].timeo.login_timeout = 15
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].timeo.auth_timeout = 45
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].iscsi.DataDigest = None
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].iscsi.IFMarker = No
Aug 27 05:10:30 user nova-compute[72904]: node.conn[0].iscsi.OFMarker = No
Aug 27 05:10:30 user nova-compute[72904]: # END RECORD
Aug 27 05:10:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd6bf0-3c18-4395-b6be-993d85f00eb7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47f635b-057f-4d8c-9aa6-4d9a2ea6cf67]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUOVWiwm {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUOVWiwm" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7716add-675b-4384-a1d0-b88876868895]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUOVWiwm'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a78b6b9-f66a-4d89-bc19-14fe873986ad]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d5feba-36ed-4a53-9f0b-224bc4f8e16e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:10:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:10:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.196s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] HCTL ('34', '0', '0', 0) found on session 25 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c87b94d-2ef1-430c-8c31-c05a7c9f7c7b]: (4, ('0 0 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching for a device in session 25 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUOVWiwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.221s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== connect_volume: return (223ms) {'type': 'block', 'scsi_wwn': '23435663738323863', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435663738323863', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179411322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179411322',id=22,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:09:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-ifzy4j22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:09:01Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=811276f1-7d8e-4b92-9cb0-239ad4121cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "vif_mac": "fa:16:3e:31:19:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "vif_mac": "fa:16:3e:31:19:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.objects.instance [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'pci_devices' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.objects.base [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<811276f1-7d8e-4b92-9cb0-239ad4121cff> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:10:30 user nova-compute[72904]:   <uuid>811276f1-7d8e-4b92-9cb0-239ad4121cff</uuid>
Aug 27 05:10:30 user nova-compute[72904]:   <name>instance-00000016</name>
Aug 27 05:10:30 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:10:30 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:10:30 user nova-compute[72904]:   <metadata>
Aug 27 05:10:30 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:10:30 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:10:30 user nova-compute[72904]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-179411322</nova:name>
Aug 27 05:10:30 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:10:30</nova:creationTime>
Aug 27 05:10:30 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:10:30 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:10:30 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:10:30 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:10:30 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:10:30 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:10:30 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:10:30 user nova-compute[72904]:       <nova:owner>
Aug 27 05:10:30 user nova-compute[72904]:         <nova:user uuid="f4bbded3a71e4d6196d83c1fa5e7a868">tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member</nova:user>
Aug 27 05:10:30 user nova-compute[72904]:         <nova:project uuid="da9ae29302d54f8aa82e6c51bbfba65d">tempest-ServerBootFromVolumeStableRescueTest-1493340065</nova:project>
Aug 27 05:10:30 user nova-compute[72904]:       </nova:owner>
Aug 27 05:10:30 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:10:30 user nova-compute[72904]:       <nova:ports>
Aug 27 05:10:30 user nova-compute[72904]:         <nova:port uuid="14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6">
Aug 27 05:10:30 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 05:10:30 user nova-compute[72904]:         </nova:port>
Aug 27 05:10:30 user nova-compute[72904]:       </nova:ports>
Aug 27 05:10:30 user nova-compute[72904]:     </nova:instance>
Aug 27 05:10:30 user nova-compute[72904]:   </metadata>
Aug 27 05:10:30 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:10:30 user nova-compute[72904]:     <system>
Aug 27 05:10:30 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:10:30 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:10:30 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:10:30 user nova-compute[72904]:       <entry name="serial">811276f1-7d8e-4b92-9cb0-239ad4121cff</entry>
Aug 27 05:10:30 user nova-compute[72904]:       <entry name="uuid">811276f1-7d8e-4b92-9cb0-239ad4121cff</entry>
Aug 27 05:10:30 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:10:30 user nova-compute[72904]:     </system>
Aug 27 05:10:30 user nova-compute[72904]:   </sysinfo>
Aug 27 05:10:30 user nova-compute[72904]:   <os>
Aug 27 05:10:30 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:10:30 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:10:30 user nova-compute[72904]:   </os>
Aug 27 05:10:30 user nova-compute[72904]:   <features>
Aug 27 05:10:30 user nova-compute[72904]:     <acpi/>
Aug 27 05:10:30 user nova-compute[72904]:     <apic/>
Aug 27 05:10:30 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:10:30 user nova-compute[72904]:   </features>
Aug 27 05:10:30 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:10:30 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:10:30 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:10:30 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:10:30 user nova-compute[72904]:   </clock>
Aug 27 05:10:30 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:10:30 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:10:30 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:10:30 user nova-compute[72904]:   </cpu>
Aug 27 05:10:30 user nova-compute[72904]:   <devices>
Aug 27 05:10:30 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:10:30 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:10:30 user nova-compute[72904]:       <source dev="/dev/sdc"/>
Aug 27 05:10:30 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:10:30 user nova-compute[72904]:       <serial>88473f29-16df-48ce-aa93-4488a695edeb</serial>
Aug 27 05:10:30 user nova-compute[72904]:     </disk>
Aug 27 05:10:30 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:10:30 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:10:30 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue"/>
Aug 27 05:10:30 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:10:30 user nova-compute[72904]:       <boot order="1"/>
Aug 27 05:10:30 user nova-compute[72904]:     </disk>
Aug 27 05:10:30 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:10:30 user nova-compute[72904]:       <mac address="fa:16:3e:31:19:c7"/>
Aug 27 05:10:30 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:10:30 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:10:30 user nova-compute[72904]:       <target dev="tap14e518d8-3b"/>
Aug 27 05:10:30 user nova-compute[72904]:     </interface>
Aug 27 05:10:30 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:10:30 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/console.log" append="off"/>
Aug 27 05:10:30 user nova-compute[72904]:     </serial>
Aug 27 05:10:30 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:10:30 user nova-compute[72904]:     <video>
Aug 27 05:10:30 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:10:30 user nova-compute[72904]:     </video>
Aug 27 05:10:30 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:10:30 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:10:30 user nova-compute[72904]:     </rng>
Aug 27 05:10:30 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:10:30 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:10:30 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:10:30 user nova-compute[72904]:     </memballoon>
Aug 27 05:10:30 user nova-compute[72904]:   </devices>
Aug 27 05:10:30 user nova-compute[72904]: </domain>
Aug 27 05:10:30 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:10:30 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance destroyed successfully.
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No VIF found with MAC fa:16:3e:31:19:c7, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-4f87daa5-ab36-4ac7-bf75-b0c4e762d79c req-2bcd20cf-7055-461f-8e99-1f0f7fedcea0 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4f87daa5-ab36-4ac7-bf75-b0c4e762d79c req-2bcd20cf-7055-461f-8e99-1f0f7fedcea0 service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4f87daa5-ab36-4ac7-bf75-b0c4e762d79c req-2bcd20cf-7055-461f-8e99-1f0f7fedcea0 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4f87daa5-ab36-4ac7-bf75-b0c4e762d79c req-2bcd20cf-7055-461f-8e99-1f0f7fedcea0 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-4f87daa5-ab36-4ac7-bf75-b0c4e762d79c req-2bcd20cf-7055-461f-8e99-1f0f7fedcea0 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:31 user nova-compute[72904]: WARNING nova.compute.manager [req-4f87daa5-ab36-4ac7-bf75-b0c4e762d79c req-2bcd20cf-7055-461f-8e99-1f0f7fedcea0 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received unexpected event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with vm_state building and task_state spawning.
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113031.7694125, e8403a20-3d6b-4897-b697-fdb1e7722e4f => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] VM Resumed (Lifecycle Event)
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:10:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance spawned successfully.
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113031.7719698, e8403a20-3d6b-4897-b697-fdb1e7722e4f => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] VM Started (Lifecycle Event)
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:10:31 user nova-compute[72904]: INFO nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Took 7.94 seconds to spawn the instance on the hypervisor.
Aug 27 05:10:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:32 user nova-compute[72904]: INFO nova.compute.manager [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Took 8.84 seconds to build instance.
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d4a0666d-8670-4df9-8e91-bd68086a1734 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.957s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-7b9a8ab2-d29b-47e4-9cd7-f2339b09bbac req-610e1ea4-1f59-4be6-bd08-224f59ad51f6 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7b9a8ab2-d29b-47e4-9cd7-f2339b09bbac req-610e1ea4-1f59-4be6-bd08-224f59ad51f6 service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7b9a8ab2-d29b-47e4-9cd7-f2339b09bbac req-610e1ea4-1f59-4be6-bd08-224f59ad51f6 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7b9a8ab2-d29b-47e4-9cd7-f2339b09bbac req-610e1ea4-1f59-4be6-bd08-224f59ad51f6 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-7b9a8ab2-d29b-47e4-9cd7-f2339b09bbac req-610e1ea4-1f59-4be6-bd08-224f59ad51f6 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:32 user nova-compute[72904]: WARNING nova.compute.manager [req-7b9a8ab2-d29b-47e4-9cd7-f2339b09bbac req-610e1ea4-1f59-4be6-bd08-224f59ad51f6 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state active and task_state rescuing.
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 811276f1-7d8e-4b92-9cb0-239ad4121cff due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113034.37573, 811276f1-7d8e-4b92-9cb0-239ad4121cff => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:34 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] VM Resumed (Lifecycle Event)
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-96734ada-1012-40ff-9b8a-396386060780 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113034.3792439, 811276f1-7d8e-4b92-9cb0-239ad4121cff => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:34 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] VM Started (Lifecycle Event)
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-4d2d3da0-26db-4354-ab9a-6f2a766f7e5d req-315d2bae-7095-4080-9f29-2663ecccfdae service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4d2d3da0-26db-4354-ab9a-6f2a766f7e5d req-315d2bae-7095-4080-9f29-2663ecccfdae service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4d2d3da0-26db-4354-ab9a-6f2a766f7e5d req-315d2bae-7095-4080-9f29-2663ecccfdae service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4d2d3da0-26db-4354-ab9a-6f2a766f7e5d req-315d2bae-7095-4080-9f29-2663ecccfdae service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-4d2d3da0-26db-4354-ab9a-6f2a766f7e5d req-315d2bae-7095-4080-9f29-2663ecccfdae service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:34 user nova-compute[72904]: WARNING nova.compute.manager [req-4d2d3da0-26db-4354-ab9a-6f2a766f7e5d req-315d2bae-7095-4080-9f29-2663ecccfdae service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state rescued and task_state None.
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing instance network info cache due to event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] Acquiring lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] Acquired lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json" returned: 0 in 0.279s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updated VIF entry in instance network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:36 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:36 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7709MB free_disk=25.478382110595703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79e335f1-32fe-429c-9bda-025c96c7e579 req-fd742c3e-5ca5-41e6-bcc1-49f987fab541 service nova] Releasing lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f8dad8d9-a024-4f25-b1fa-52424b79b662 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12852d71-dd0e-46da-8b7b-674551d62f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e8403a20-3d6b-4897-b697-fdb1e7722e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:10:36 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:10:38 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:10:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:10:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:41 user nova-compute[72904]: INFO nova.compute.manager [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Shelving
Aug 27 05:10:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-e7f456ab-9f75-4b0a-a33e-a24c2a3539a6 req-4232d166-b3a7-41ef-bc5d-21dff6bf8b87 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-unplugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e7f456ab-9f75-4b0a-a33e-a24c2a3539a6 req-4232d166-b3a7-41ef-bc5d-21dff6bf8b87 service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e7f456ab-9f75-4b0a-a33e-a24c2a3539a6 req-4232d166-b3a7-41ef-bc5d-21dff6bf8b87 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e7f456ab-9f75-4b0a-a33e-a24c2a3539a6 req-4232d166-b3a7-41ef-bc5d-21dff6bf8b87 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-e7f456ab-9f75-4b0a-a33e-a24c2a3539a6 req-4232d166-b3a7-41ef-bc5d-21dff6bf8b87 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-unplugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:42 user nova-compute[72904]: WARNING nova.compute.manager [req-e7f456ab-9f75-4b0a-a33e-a24c2a3539a6 req-4232d166-b3a7-41ef-bc5d-21dff6bf8b87 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received unexpected event network-vif-unplugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with vm_state active and task_state shelving.
Aug 27 05:10:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance destroyed successfully.
Aug 27 05:10:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Beginning cold snapshot process
Aug 27 05:10:42 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:10:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk /opt/stack/data/nova/instances/snapshots/tmpldqhbwpw/4fdbdda2eff5407cbcd8387b1a05719e {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:10:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk /opt/stack/data/nova/instances/snapshots/tmpldqhbwpw/4fdbdda2eff5407cbcd8387b1a05719e" returned: 0 in 0.630s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:10:43 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Snapshot extracted, beginning image upload
Aug 27 05:10:44 user nova-compute[72904]: DEBUG nova.compute.manager [req-cf23afd4-8bef-4e81-8cd3-9d2a19b6106a req-23c8a1b9-8a4a-4d5e-afe4-37779be03cae service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cf23afd4-8bef-4e81-8cd3-9d2a19b6106a req-23c8a1b9-8a4a-4d5e-afe4-37779be03cae service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cf23afd4-8bef-4e81-8cd3-9d2a19b6106a req-23c8a1b9-8a4a-4d5e-afe4-37779be03cae service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cf23afd4-8bef-4e81-8cd3-9d2a19b6106a req-23c8a1b9-8a4a-4d5e-afe4-37779be03cae service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:44 user nova-compute[72904]: DEBUG nova.compute.manager [req-cf23afd4-8bef-4e81-8cd3-9d2a19b6106a req-23c8a1b9-8a4a-4d5e-afe4-37779be03cae service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:10:44 user nova-compute[72904]: WARNING nova.compute.manager [req-cf23afd4-8bef-4e81-8cd3-9d2a19b6106a req-23c8a1b9-8a4a-4d5e-afe4-37779be03cae service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received unexpected event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 05:10:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Snapshot image upload complete
Aug 27 05:10:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:45 user nova-compute[72904]: INFO nova.compute.manager [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Shelve offloading
Aug 27 05:10:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance destroyed successfully.
Aug 27 05:10:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:10:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquired lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Releasing lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:46 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance destroyed successfully.
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'resources' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-413967328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-413967328',id=23,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFku25PHmoznQMdudBzjCXX/wLaRl7v7i6gLmaYKiZO6y2ja27uNo/ZvfHD5Y1lw+O/TAAKEsczYCaWj1NTWE1JuUOay9FWnNSMtYenwgtjIhxOEc25uPhOzioyDsk9ig==',key_name='tempest-keypair-272173837',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-gy814sik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member',shelved_at='2023-08-27T05:10:45.647294',shelved_host='user',shelved_image_id='7c11121c-dcd3-4da1-9163-f72105fe9ea7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:10:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=f8dad8d9-a024-4f25-b1fa-52424b79b662,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG os_vif [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing instance network info cache due to event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] Acquiring lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] Acquired lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.network.neutron [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3874404d-4f, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:46 user nova-compute[72904]: INFO os_vif [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f')
Aug 27 05:10:46 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Deleting instance files /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662_del
Aug 27 05:10:46 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Deletion of /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662_del complete
Aug 27 05:10:46 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Deleted allocations for instance f8dad8d9-a024-4f25-b1fa-52424b79b662
Aug 27 05:10:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:10:46 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'numa_topology' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG nova.objects.base [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<f8dad8d9-a024-4f25-b1fa-52424b79b662> lazy-loaded attributes: resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbccf06f-3b11-46dd-91db-9c9d222e2ba7 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.769s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updated VIF entry in instance network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3874404d-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:10:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-85869037-d6a7-4acb-a9f6-d82646475272 req-695e242a-56f5-42ad-a171-e08797499ae4 service nova] Releasing lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:10:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:10:57 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113042.2867782, f8dad8d9-a024-4f25-b1fa-52424b79b662 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:10:57 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] VM Stopped (Lifecycle Event)
Aug 27 05:10:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-57c54a88-8cb2-4e94-b89c-ca4bf39a121c None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:11:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:11:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:11:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:29 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:11:29 user nova-compute[72904]: INFO nova.compute.claims [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Claim successful on node user
Aug 27 05:11:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.488s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.606s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:11:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.policy [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21601eb4d7bd479aaaa27ed3040f4dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d80813c21429b836763fdeefb32fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:11:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Creating image(s)
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "/opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "/opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.223s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk 1073741824" returned: 0 in 0.060s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Cannot resize image /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Ensure instance console log exists: /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Successfully created port: 28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Successfully updated port: 28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquired lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-changed-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Refreshing instance network info cache due to event network-changed-28a8a801-ba7a-46bc-b814-6032fd49ebb6. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] Acquiring lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:34 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:11:34 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:11:34 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=24.561668395996094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12852d71-dd0e-46da-8b7b-674551d62f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e8403a20-3d6b-4897-b697-fdb1e7722e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updating instance_info_cache with network_info: [{"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Releasing lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Instance network_info: |[{"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] Acquired lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Refreshing network info cache for port 28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Start _get_guest_xml network_info=[{"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:11:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:11:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-940434153',display_name='tempest-TestStampPattern-server-940434153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-940434153',id=26,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkwT0EoE+efmSUPXfVnAKwZs3gchQqxEsGoSc6Z2oMKPhVS2FXSU8GCbc7XVowgKS4arjEQy/QXsY6Tc1MDzDaqgmC2lO07jOsRf3bFi2v/ztZO6o9+6NmJW5aEdh8ebg==',key_name='tempest-TestStampPattern-1730672637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='773d80813c21429b836763fdeefb32fd',ramdisk_id='',reservation_id='r-1spg85uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-885956166',owner_user_name='tempest-TestStampPattern-885956166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:11:32Z,user_data=None,user_id='21601eb4d7bd479aaaa27ed3040f4dd1',uuid=6c4f94ac-01ca-4028-a5d6-f3535edaaa7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converting VIF {"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:d8,bridge_name='br-int',has_traffic_filtering=True,id=28a8a801-ba7a-46bc-b814-6032fd49ebb6,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a8a801-ba') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:11:35 user nova-compute[72904]:   <uuid>6c4f94ac-01ca-4028-a5d6-f3535edaaa7a</uuid>
Aug 27 05:11:35 user nova-compute[72904]:   <name>instance-0000001a</name>
Aug 27 05:11:35 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:11:35 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:11:35 user nova-compute[72904]:   <metadata>
Aug 27 05:11:35 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:11:35 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:11:35 user nova-compute[72904]:       <nova:name>tempest-TestStampPattern-server-940434153</nova:name>
Aug 27 05:11:35 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:11:35</nova:creationTime>
Aug 27 05:11:35 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:11:35 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:11:35 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:11:35 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:11:35 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:11:35 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:11:35 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:11:35 user nova-compute[72904]:       <nova:owner>
Aug 27 05:11:35 user nova-compute[72904]:         <nova:user uuid="21601eb4d7bd479aaaa27ed3040f4dd1">tempest-TestStampPattern-885956166-project-member</nova:user>
Aug 27 05:11:35 user nova-compute[72904]:         <nova:project uuid="773d80813c21429b836763fdeefb32fd">tempest-TestStampPattern-885956166</nova:project>
Aug 27 05:11:35 user nova-compute[72904]:       </nova:owner>
Aug 27 05:11:35 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:11:35 user nova-compute[72904]:       <nova:ports>
Aug 27 05:11:35 user nova-compute[72904]:         <nova:port uuid="28a8a801-ba7a-46bc-b814-6032fd49ebb6">
Aug 27 05:11:35 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 05:11:35 user nova-compute[72904]:         </nova:port>
Aug 27 05:11:35 user nova-compute[72904]:       </nova:ports>
Aug 27 05:11:35 user nova-compute[72904]:     </nova:instance>
Aug 27 05:11:35 user nova-compute[72904]:   </metadata>
Aug 27 05:11:35 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:11:35 user nova-compute[72904]:     <system>
Aug 27 05:11:35 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:11:35 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:11:35 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:11:35 user nova-compute[72904]:       <entry name="serial">6c4f94ac-01ca-4028-a5d6-f3535edaaa7a</entry>
Aug 27 05:11:35 user nova-compute[72904]:       <entry name="uuid">6c4f94ac-01ca-4028-a5d6-f3535edaaa7a</entry>
Aug 27 05:11:35 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:11:35 user nova-compute[72904]:     </system>
Aug 27 05:11:35 user nova-compute[72904]:   </sysinfo>
Aug 27 05:11:35 user nova-compute[72904]:   <os>
Aug 27 05:11:35 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:11:35 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:11:35 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:11:35 user nova-compute[72904]:   </os>
Aug 27 05:11:35 user nova-compute[72904]:   <features>
Aug 27 05:11:35 user nova-compute[72904]:     <acpi/>
Aug 27 05:11:35 user nova-compute[72904]:     <apic/>
Aug 27 05:11:35 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:11:35 user nova-compute[72904]:   </features>
Aug 27 05:11:35 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:11:35 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:11:35 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:11:35 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:11:35 user nova-compute[72904]:   </clock>
Aug 27 05:11:35 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:11:35 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:11:35 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:11:35 user nova-compute[72904]:   </cpu>
Aug 27 05:11:35 user nova-compute[72904]:   <devices>
Aug 27 05:11:35 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:11:35 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:11:35 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk"/>
Aug 27 05:11:35 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:11:35 user nova-compute[72904]:     </disk>
Aug 27 05:11:35 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:11:35 user nova-compute[72904]:       <mac address="fa:16:3e:1c:87:d8"/>
Aug 27 05:11:35 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:11:35 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:11:35 user nova-compute[72904]:       <target dev="tap28a8a801-ba"/>
Aug 27 05:11:35 user nova-compute[72904]:     </interface>
Aug 27 05:11:35 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:11:35 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/console.log" append="off"/>
Aug 27 05:11:35 user nova-compute[72904]:     </serial>
Aug 27 05:11:35 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:11:35 user nova-compute[72904]:     <video>
Aug 27 05:11:35 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:11:35 user nova-compute[72904]:     </video>
Aug 27 05:11:35 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:11:35 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:11:35 user nova-compute[72904]:     </rng>
Aug 27 05:11:35 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:11:35 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:11:35 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:11:35 user nova-compute[72904]:     </memballoon>
Aug 27 05:11:35 user nova-compute[72904]:   </devices>
Aug 27 05:11:35 user nova-compute[72904]: </domain>
Aug 27 05:11:35 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-940434153',display_name='tempest-TestStampPattern-server-940434153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-940434153',id=26,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkwT0EoE+efmSUPXfVnAKwZs3gchQqxEsGoSc6Z2oMKPhVS2FXSU8GCbc7XVowgKS4arjEQy/QXsY6Tc1MDzDaqgmC2lO07jOsRf3bFi2v/ztZO6o9+6NmJW5aEdh8ebg==',key_name='tempest-TestStampPattern-1730672637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='773d80813c21429b836763fdeefb32fd',ramdisk_id='',reservation_id='r-1spg85uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-885956166',owner_user_name='tempest-TestStampPattern-885956166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:11:32Z,user_data=None,user_id='21601eb4d7bd479aaaa27ed3040f4dd1',uuid=6c4f94ac-01ca-4028-a5d6-f3535edaaa7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converting VIF {"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:d8,bridge_name='br-int',has_traffic_filtering=True,id=28a8a801-ba7a-46bc-b814-6032fd49ebb6,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a8a801-ba') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG os_vif [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:d8,bridge_name='br-int',has_traffic_filtering=True,id=28a8a801-ba7a-46bc-b814-6032fd49ebb6,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a8a801-ba') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28a8a801-ba, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28a8a801-ba, col_values=(('external_ids', {'iface-id': '28a8a801-ba7a-46bc-b814-6032fd49ebb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:87:d8', 'vm-uuid': '6c4f94ac-01ca-4028-a5d6-f3535edaaa7a'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:35 user nova-compute[72904]: INFO os_vif [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:d8,bridge_name='br-int',has_traffic_filtering=True,id=28a8a801-ba7a-46bc-b814-6032fd49ebb6,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a8a801-ba')
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No VIF found with MAC fa:16:3e:1c:87:d8, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updated VIF entry in instance network info cache for port 28a8a801-ba7a-46bc-b814-6032fd49ebb6. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updating instance_info_cache with network_info: [{"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:11:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3518ecb8-8f7b-4e21-b16d-a0a30990d8a2 req-24d1eb2e-1f12-41ea-ae10-e82480c9ac13 service nova] Releasing lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Skipping network cache update for instance because it is Building. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:11:36 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:11:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:38 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:11:38 user nova-compute[72904]: INFO nova.compute.claims [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Claim successful on node user
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.policy [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6670bcb268ea456c90c8b91752f8e1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e040778d6181423cb5ac0349e1ac1d46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Creating image(s)
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "/opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "/opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113099.390048, 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] VM Resumed (Lifecycle Event)
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Instance spawned successfully.
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113099.391677, 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] VM Started (Lifecycle Event)
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Took 7.90 seconds to spawn the instance on the hypervisor.
Aug 27 05:11:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:39 user nova-compute[72904]: INFO nova.compute.manager [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Took 9.95 seconds to build instance.
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ccfa094c-15db-41d6-b68c-67fd0c78db7a tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.431s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk 1073741824" returned: 0 in 0.112s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Successfully created port: 811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Cannot resize image /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Ensure instance console log exists: /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.compute.manager [req-2fa3c434-eda4-45ea-a34b-4829fb2c5f17 req-95f8d5a3-d8ff-47d9-8492-d739da462986 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2fa3c434-eda4-45ea-a34b-4829fb2c5f17 req-95f8d5a3-d8ff-47d9-8492-d739da462986 service nova] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2fa3c434-eda4-45ea-a34b-4829fb2c5f17 req-95f8d5a3-d8ff-47d9-8492-d739da462986 service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2fa3c434-eda4-45ea-a34b-4829fb2c5f17 req-95f8d5a3-d8ff-47d9-8492-d739da462986 service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.compute.manager [req-2fa3c434-eda4-45ea-a34b-4829fb2c5f17 req-95f8d5a3-d8ff-47d9-8492-d739da462986 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] No waiting events found dispatching network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:40 user nova-compute[72904]: WARNING nova.compute.manager [req-2fa3c434-eda4-45ea-a34b-4829fb2c5f17 req-95f8d5a3-d8ff-47d9-8492-d739da462986 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received unexpected event network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 for instance with vm_state active and task_state None.
Aug 27 05:11:40 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Successfully updated port: 811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquired lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-changed-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Refreshing instance network info cache due to event network-changed-811a678a-fd9d-44ff-96c5-1a76b0bd0df3. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] Acquiring lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updating instance_info_cache with network_info: [{"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Releasing lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Instance network_info: |[{"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] Acquired lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.neutron [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Refreshing network info cache for port 811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Start _get_guest_xml network_info=[{"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:11:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:11:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1976467830',display_name='tempest-TestServerVolumeAttachmentScenario-server-1976467830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1976467830',id=27,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIMWCgptePRTE0D9cULjtELEFrvjgBqVbtl9MUHuBZ7GifZlADKuhbNiSpRHSYiFOWsCoU7iJN9hLKYx3uAHsCwsaILuUNhr3HOygms8GNu8wcUOaNlGvQZCQXBAnUcMQ==',key_name='tempest-keypair-1041924444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e040778d6181423cb5ac0349e1ac1d46',ramdisk_id='',reservation_id='r-jwx3ff88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1750885603',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1750885603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6670bcb268ea456c90c8b91752f8e1fa',uuid=8b96c2eb-dd8b-4d42-94de-dab850795ecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Converting VIF {"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b9:68,bridge_name='br-int',has_traffic_filtering=True,id=811a678a-fd9d-44ff-96c5-1a76b0bd0df3,network=Network(90dc5c3c-0e43-4870-837d-a7054d991070),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811a678a-fd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.objects.instance [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:11:41 user nova-compute[72904]:   <uuid>8b96c2eb-dd8b-4d42-94de-dab850795ecd</uuid>
Aug 27 05:11:41 user nova-compute[72904]:   <name>instance-0000001b</name>
Aug 27 05:11:41 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:11:41 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:11:41 user nova-compute[72904]:   <metadata>
Aug 27 05:11:41 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:11:41 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:11:41 user nova-compute[72904]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1976467830</nova:name>
Aug 27 05:11:41 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:11:41</nova:creationTime>
Aug 27 05:11:41 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:11:41 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:11:41 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:11:41 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:11:41 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:11:41 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:11:41 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:11:41 user nova-compute[72904]:       <nova:owner>
Aug 27 05:11:41 user nova-compute[72904]:         <nova:user uuid="6670bcb268ea456c90c8b91752f8e1fa">tempest-TestServerVolumeAttachmentScenario-1750885603-project-member</nova:user>
Aug 27 05:11:41 user nova-compute[72904]:         <nova:project uuid="e040778d6181423cb5ac0349e1ac1d46">tempest-TestServerVolumeAttachmentScenario-1750885603</nova:project>
Aug 27 05:11:41 user nova-compute[72904]:       </nova:owner>
Aug 27 05:11:41 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:11:41 user nova-compute[72904]:       <nova:ports>
Aug 27 05:11:41 user nova-compute[72904]:         <nova:port uuid="811a678a-fd9d-44ff-96c5-1a76b0bd0df3">
Aug 27 05:11:41 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:11:41 user nova-compute[72904]:         </nova:port>
Aug 27 05:11:41 user nova-compute[72904]:       </nova:ports>
Aug 27 05:11:41 user nova-compute[72904]:     </nova:instance>
Aug 27 05:11:41 user nova-compute[72904]:   </metadata>
Aug 27 05:11:41 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:11:41 user nova-compute[72904]:     <system>
Aug 27 05:11:41 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:11:41 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:11:41 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:11:41 user nova-compute[72904]:       <entry name="serial">8b96c2eb-dd8b-4d42-94de-dab850795ecd</entry>
Aug 27 05:11:41 user nova-compute[72904]:       <entry name="uuid">8b96c2eb-dd8b-4d42-94de-dab850795ecd</entry>
Aug 27 05:11:41 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:11:41 user nova-compute[72904]:     </system>
Aug 27 05:11:41 user nova-compute[72904]:   </sysinfo>
Aug 27 05:11:41 user nova-compute[72904]:   <os>
Aug 27 05:11:41 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:11:41 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:11:41 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:11:41 user nova-compute[72904]:   </os>
Aug 27 05:11:41 user nova-compute[72904]:   <features>
Aug 27 05:11:41 user nova-compute[72904]:     <acpi/>
Aug 27 05:11:41 user nova-compute[72904]:     <apic/>
Aug 27 05:11:41 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:11:41 user nova-compute[72904]:   </features>
Aug 27 05:11:41 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:11:41 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:11:41 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:11:41 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:11:41 user nova-compute[72904]:   </clock>
Aug 27 05:11:41 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:11:41 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:11:41 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:11:41 user nova-compute[72904]:   </cpu>
Aug 27 05:11:41 user nova-compute[72904]:   <devices>
Aug 27 05:11:41 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:11:41 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:11:41 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk"/>
Aug 27 05:11:41 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:11:41 user nova-compute[72904]:     </disk>
Aug 27 05:11:41 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:11:41 user nova-compute[72904]:       <mac address="fa:16:3e:f2:b9:68"/>
Aug 27 05:11:41 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:11:41 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:11:41 user nova-compute[72904]:       <target dev="tap811a678a-fd"/>
Aug 27 05:11:41 user nova-compute[72904]:     </interface>
Aug 27 05:11:41 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:11:41 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/console.log" append="off"/>
Aug 27 05:11:41 user nova-compute[72904]:     </serial>
Aug 27 05:11:41 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:11:41 user nova-compute[72904]:     <video>
Aug 27 05:11:41 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:11:41 user nova-compute[72904]:     </video>
Aug 27 05:11:41 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:11:41 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:11:41 user nova-compute[72904]:     </rng>
Aug 27 05:11:41 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:11:41 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:11:41 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:11:41 user nova-compute[72904]:     </memballoon>
Aug 27 05:11:41 user nova-compute[72904]:   </devices>
Aug 27 05:11:41 user nova-compute[72904]: </domain>
Aug 27 05:11:41 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1976467830',display_name='tempest-TestServerVolumeAttachmentScenario-server-1976467830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1976467830',id=27,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIMWCgptePRTE0D9cULjtELEFrvjgBqVbtl9MUHuBZ7GifZlADKuhbNiSpRHSYiFOWsCoU7iJN9hLKYx3uAHsCwsaILuUNhr3HOygms8GNu8wcUOaNlGvQZCQXBAnUcMQ==',key_name='tempest-keypair-1041924444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e040778d6181423cb5ac0349e1ac1d46',ramdisk_id='',reservation_id='r-jwx3ff88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1750885603',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1750885603-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:11:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6670bcb268ea456c90c8b91752f8e1fa',uuid=8b96c2eb-dd8b-4d42-94de-dab850795ecd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Converting VIF {"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b9:68,bridge_name='br-int',has_traffic_filtering=True,id=811a678a-fd9d-44ff-96c5-1a76b0bd0df3,network=Network(90dc5c3c-0e43-4870-837d-a7054d991070),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811a678a-fd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG os_vif [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b9:68,bridge_name='br-int',has_traffic_filtering=True,id=811a678a-fd9d-44ff-96c5-1a76b0bd0df3,network=Network(90dc5c3c-0e43-4870-837d-a7054d991070),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811a678a-fd') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap811a678a-fd, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap811a678a-fd, col_values=(('external_ids', {'iface-id': '811a678a-fd9d-44ff-96c5-1a76b0bd0df3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:b9:68', 'vm-uuid': '8b96c2eb-dd8b-4d42-94de-dab850795ecd'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:41 user nova-compute[72904]: INFO os_vif [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:b9:68,bridge_name='br-int',has_traffic_filtering=True,id=811a678a-fd9d-44ff-96c5-1a76b0bd0df3,network=Network(90dc5c3c-0e43-4870-837d-a7054d991070),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811a678a-fd')
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:11:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No VIF found with MAC fa:16:3e:f2:b9:68, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG nova.network.neutron [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updated VIF entry in instance network info cache for port 811a678a-fd9d-44ff-96c5-1a76b0bd0df3. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG nova.network.neutron [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updating instance_info_cache with network_info: [{"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e8109c9d-1d9e-4bc7-901b-dc5c5b655100 req-37c354f2-01ea-4774-8a6e-9baf63d92eec service nova] Releasing lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-a2269322-ce40-466a-9f77-d44722024615 req-0c812cbc-b268-4984-98a8-ed1b95ce8913 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a2269322-ce40-466a-9f77-d44722024615 req-0c812cbc-b268-4984-98a8-ed1b95ce8913 service nova] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a2269322-ce40-466a-9f77-d44722024615 req-0c812cbc-b268-4984-98a8-ed1b95ce8913 service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a2269322-ce40-466a-9f77-d44722024615 req-0c812cbc-b268-4984-98a8-ed1b95ce8913 service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-a2269322-ce40-466a-9f77-d44722024615 req-0c812cbc-b268-4984-98a8-ed1b95ce8913 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] No waiting events found dispatching network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:42 user nova-compute[72904]: WARNING nova.compute.manager [req-a2269322-ce40-466a-9f77-d44722024615 req-0c812cbc-b268-4984-98a8-ed1b95ce8913 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received unexpected event network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 for instance with vm_state active and task_state None.
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-48119244-0a3e-4af6-ad15-4a094c1d05df req-4c02be30-734d-41d9-94da-b7903d10839d service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48119244-0a3e-4af6-ad15-4a094c1d05df req-4c02be30-734d-41d9-94da-b7903d10839d service nova] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48119244-0a3e-4af6-ad15-4a094c1d05df req-4c02be30-734d-41d9-94da-b7903d10839d service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48119244-0a3e-4af6-ad15-4a094c1d05df req-4c02be30-734d-41d9-94da-b7903d10839d service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-48119244-0a3e-4af6-ad15-4a094c1d05df req-4c02be30-734d-41d9-94da-b7903d10839d service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] No waiting events found dispatching network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:43 user nova-compute[72904]: WARNING nova.compute.manager [req-48119244-0a3e-4af6-ad15-4a094c1d05df req-4c02be30-734d-41d9-94da-b7903d10839d service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received unexpected event network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 for instance with vm_state building and task_state spawning.
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113105.3078616, 8b96c2eb-dd8b-4d42-94de-dab850795ecd => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:11:45 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] VM Resumed (Lifecycle Event)
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:11:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Instance spawned successfully.
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:11:45 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113105.308638, 8b96c2eb-dd8b-4d42-94de-dab850795ecd => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:11:45 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] VM Started (Lifecycle Event)
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-e33c1457-1fad-45c8-82bf-50d62d521f17 req-3b194cef-00d0-4a92-a302-a4ba036626bc service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e33c1457-1fad-45c8-82bf-50d62d521f17 req-3b194cef-00d0-4a92-a302-a4ba036626bc service nova] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e33c1457-1fad-45c8-82bf-50d62d521f17 req-3b194cef-00d0-4a92-a302-a4ba036626bc service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e33c1457-1fad-45c8-82bf-50d62d521f17 req-3b194cef-00d0-4a92-a302-a4ba036626bc service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-e33c1457-1fad-45c8-82bf-50d62d521f17 req-3b194cef-00d0-4a92-a302-a4ba036626bc service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] No waiting events found dispatching network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:45 user nova-compute[72904]: WARNING nova.compute.manager [req-e33c1457-1fad-45c8-82bf-50d62d521f17 req-3b194cef-00d0-4a92-a302-a4ba036626bc service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received unexpected event network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 for instance with vm_state building and task_state spawning.
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:11:45 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:11:45 user nova-compute[72904]: INFO nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 27 05:11:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:45 user nova-compute[72904]: INFO nova.compute.manager [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Took 6.96 seconds to build instance.
Aug 27 05:11:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0ca8557f-b759-4502-871f-b3ed8aca6822 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.080s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:46 user nova-compute[72904]: INFO nova.compute.manager [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Unrescuing
Aug 27 05:11:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:11:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:11:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'flavor' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-272af4b7-47bd-4a48-97c8-d4705e49379d req-ae8e00d0-808c-499e-a209-70340a93cd77 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-272af4b7-47bd-4a48-97c8-d4705e49379d req-ae8e00d0-808c-499e-a209-70340a93cd77 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-272af4b7-47bd-4a48-97c8-d4705e49379d req-ae8e00d0-808c-499e-a209-70340a93cd77 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-272af4b7-47bd-4a48-97c8-d4705e49379d req-ae8e00d0-808c-499e-a209-70340a93cd77 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-272af4b7-47bd-4a48-97c8-d4705e49379d req-ae8e00d0-808c-499e-a209-70340a93cd77 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:47 user nova-compute[72904]: WARNING nova.compute.manager [req-272af4b7-47bd-4a48-97c8-d4705e49379d req-ae8e00d0-808c-499e-a209-70340a93cd77 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:11:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance destroyed successfully.
Aug 27 05:11:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-ae062905-43f2-4287-8468-0432b75224a1 req-3d52c28a-8604-4963-a7e2-fef3d5eff3c1 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ae062905-43f2-4287-8468-0432b75224a1 req-3d52c28a-8604-4963-a7e2-fef3d5eff3c1 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ae062905-43f2-4287-8468-0432b75224a1 req-3d52c28a-8604-4963-a7e2-fef3d5eff3c1 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ae062905-43f2-4287-8468-0432b75224a1 req-3d52c28a-8604-4963-a7e2-fef3d5eff3c1 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-ae062905-43f2-4287-8468-0432b75224a1 req-3d52c28a-8604-4963-a7e2-fef3d5eff3c1 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:49 user nova-compute[72904]: WARNING nova.compute.manager [req-ae062905-43f2-4287-8468-0432b75224a1 req-3d52c28a-8604-4963-a7e2-fef3d5eff3c1 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:11:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:51 user nova-compute[72904]: WARNING nova.compute.manager [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:11:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:11:51 user nova-compute[72904]: WARNING nova.compute.manager [req-22ce0c2c-b472-4982-af65-ad34d80b81cc req-85b55acb-5bf7-4e86-8886-55ae27476872 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 19a548f0-90c2-47bb-8a68-7a788d7d736b due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113112.08939, 19a548f0-90c2-47bb-8a68-7a788d7d736b => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:11:52 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] VM Resumed (Lifecycle Event)
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3ddedd89-b556-4f57-80c8-9d94bd6566d6 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:11:52 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113112.0908415, 19a548f0-90c2-47bb-8a68-7a788d7d736b => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:11:52 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] VM Started (Lifecycle Event)
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:11:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'flavor' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.113s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:11:55 user nova-compute[72904]: INFO nova.compute.manager [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Attaching volume 298c326d-516b-4651-b281-e38ee7f73250 to /dev/vdb
Aug 27 05:11:55 user nova-compute[72904]: DEBUG os_brick.utils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[470600e9-cf86-464c-99c7-fb3841122334]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a1f63-3e84-441c-a071-e552509d6005]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce23cd79-f675-46dd-9fc1-7abf33837da7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed926626-716a-4fbf-83e7-3cba7d313bc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:11:55 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:11:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdcf354-2048-4689-bb92-729c353a637a]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG os_brick.utils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:11:55 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating existing volume attachment record: c26b4ffb-f0cc-4857-9219-ede3f13a1373 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:11:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:11:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquired lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'info_cache' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Releasing lock "refresh_cache-ba4f9f20-2e95-465f-9b3f-4b4712b199ca" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance destroyed successfully.
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'resources' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG os_vif [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd634d4ec-36, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:12:04 user nova-compute[72904]: INFO os_vif [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36')
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Start _get_guest_xml network_info=[{"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'numa_topology' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:04 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:04 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'pci_devices' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:12:04 user nova-compute[72904]:   <uuid>ba4f9f20-2e95-465f-9b3f-4b4712b199ca</uuid>
Aug 27 05:12:04 user nova-compute[72904]:   <name>instance-0000000e</name>
Aug 27 05:12:04 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:12:04 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:12:04 user nova-compute[72904]:   <metadata>
Aug 27 05:12:04 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:12:04 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:12:04 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeTestJSON-server-1389826246</nova:name>
Aug 27 05:12:04 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:12:04</nova:creationTime>
Aug 27 05:12:04 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:12:04 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:12:04 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:12:04 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:12:04 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:12:04 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:12:04 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:12:04 user nova-compute[72904]:       <nova:owner>
Aug 27 05:12:04 user nova-compute[72904]:         <nova:user uuid="7a89184799414da9ac135289cc4781ed">tempest-AttachVolumeTestJSON-111990947-project-member</nova:user>
Aug 27 05:12:04 user nova-compute[72904]:         <nova:project uuid="a569f1146db846d7aabf09b5ca515d2d">tempest-AttachVolumeTestJSON-111990947</nova:project>
Aug 27 05:12:04 user nova-compute[72904]:       </nova:owner>
Aug 27 05:12:04 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:12:04 user nova-compute[72904]:       <nova:ports>
Aug 27 05:12:04 user nova-compute[72904]:         <nova:port uuid="d634d4ec-3655-45de-860f-ba7e1a7e3455">
Aug 27 05:12:04 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:12:04 user nova-compute[72904]:         </nova:port>
Aug 27 05:12:04 user nova-compute[72904]:       </nova:ports>
Aug 27 05:12:04 user nova-compute[72904]:     </nova:instance>
Aug 27 05:12:04 user nova-compute[72904]:   </metadata>
Aug 27 05:12:04 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:12:04 user nova-compute[72904]:     <system>
Aug 27 05:12:04 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:12:04 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:12:04 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:12:04 user nova-compute[72904]:       <entry name="serial">ba4f9f20-2e95-465f-9b3f-4b4712b199ca</entry>
Aug 27 05:12:04 user nova-compute[72904]:       <entry name="uuid">ba4f9f20-2e95-465f-9b3f-4b4712b199ca</entry>
Aug 27 05:12:04 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:12:04 user nova-compute[72904]:     </system>
Aug 27 05:12:04 user nova-compute[72904]:   </sysinfo>
Aug 27 05:12:04 user nova-compute[72904]:   <os>
Aug 27 05:12:04 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:12:04 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:12:04 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:12:04 user nova-compute[72904]:   </os>
Aug 27 05:12:04 user nova-compute[72904]:   <features>
Aug 27 05:12:04 user nova-compute[72904]:     <acpi/>
Aug 27 05:12:04 user nova-compute[72904]:     <apic/>
Aug 27 05:12:04 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:12:04 user nova-compute[72904]:   </features>
Aug 27 05:12:04 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:12:04 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:12:04 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:12:04 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:12:04 user nova-compute[72904]:   </clock>
Aug 27 05:12:04 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:12:04 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:12:04 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:12:04 user nova-compute[72904]:   </cpu>
Aug 27 05:12:04 user nova-compute[72904]:   <devices>
Aug 27 05:12:04 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:12:04 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:12:04 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk"/>
Aug 27 05:12:04 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:12:04 user nova-compute[72904]:     </disk>
Aug 27 05:12:04 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:12:04 user nova-compute[72904]:       <mac address="fa:16:3e:18:1b:7a"/>
Aug 27 05:12:04 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:04 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:12:04 user nova-compute[72904]:       <target dev="tapd634d4ec-36"/>
Aug 27 05:12:04 user nova-compute[72904]:     </interface>
Aug 27 05:12:04 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:12:04 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/console.log" append="off"/>
Aug 27 05:12:04 user nova-compute[72904]:     </serial>
Aug 27 05:12:04 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:12:04 user nova-compute[72904]:     <video>
Aug 27 05:12:04 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:04 user nova-compute[72904]:     </video>
Aug 27 05:12:04 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:12:04 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:12:04 user nova-compute[72904]:     </rng>
Aug 27 05:12:04 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:12:04 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:12:04 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:12:04 user nova-compute[72904]:     </memballoon>
Aug 27 05:12:04 user nova-compute[72904]:   </devices>
Aug 27 05:12:04 user nova-compute[72904]: </domain>
Aug 27 05:12:04 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:12:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'trusted_certs' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.objects.base [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.268s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Cannot resize image /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'migration_context' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.objects.base [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Object Instance<ba4f9f20-2e95-465f-9b3f-4b4712b199ca> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG os_vif [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd634d4ec-36, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd634d4ec-36, col_values=(('external_ids', {'iface-id': 'd634d4ec-3655-45de-860f-ba7e1a7e3455', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:1b:7a', 'vm-uuid': 'ba4f9f20-2e95-465f-9b3f-4b4712b199ca'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:12:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:06 user nova-compute[72904]: INFO os_vif [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36')
Aug 27 05:12:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-fd480048-d3bc-4e59-b88f-c594116cb8e1 req-baf7e922-7d9f-44e6-aea9-f4c4190f8d08 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fd480048-d3bc-4e59-b88f-c594116cb8e1 req-baf7e922-7d9f-44e6-aea9-f4c4190f8d08 service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fd480048-d3bc-4e59-b88f-c594116cb8e1 req-baf7e922-7d9f-44e6-aea9-f4c4190f8d08 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fd480048-d3bc-4e59-b88f-c594116cb8e1 req-baf7e922-7d9f-44e6-aea9-f4c4190f8d08 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-fd480048-d3bc-4e59-b88f-c594116cb8e1 req-baf7e922-7d9f-44e6-aea9-f4c4190f8d08 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:07 user nova-compute[72904]: WARNING nova.compute.manager [req-fd480048-d3bc-4e59-b88f-c594116cb8e1 req-baf7e922-7d9f-44e6-aea9-f4c4190f8d08 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state stopped and task_state powering-on.
Aug 27 05:12:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRctPSly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:08 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:08 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:08 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a785463-2e03-4237-bfb4-c6fc935bee08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:12:08 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f190410-daf5-4624-89a8-bf94f72e70a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250] added
Aug 27 05:12:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adb898b-daff-433e-8cb9-fd8e2710bad8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64ef330-77ea-4d96-a8fc-85a1943aaa28]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRctPSly {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRctPSly" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3bf62a-3bf9-4c29-b46d-f8063c30d1b3]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kRctPSly'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb629880-b4e1-4ae8-85db-7e5b4c900c27]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e441830-0b00-4098-8d07-3213ebf6da2c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c5e489-dd8a-4a5c-b9f4-3a36345ddca3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]
Aug 27 05:12:08 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.
Aug 27 05:12:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d85e02-1f61-4c2d-988d-63cb9e2bb81c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeb84cd-9f75-4c87-9445-a2098c9f978e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:08 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:08 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5e759-4f53-4800-b6b5-306ea43d28e6]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:12:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRctPSly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-e4b9d800-9592-4c89-95c8-27f1cb94ebca req-ef6e562d-1284-4563-98eb-b046ef570f64 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e4b9d800-9592-4c89-95c8-27f1cb94ebca req-ef6e562d-1284-4563-98eb-b046ef570f64 service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e4b9d800-9592-4c89-95c8-27f1cb94ebca req-ef6e562d-1284-4563-98eb-b046ef570f64 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e4b9d800-9592-4c89-95c8-27f1cb94ebca req-ef6e562d-1284-4563-98eb-b046ef570f64 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-e4b9d800-9592-4c89-95c8-27f1cb94ebca req-ef6e562d-1284-4563-98eb-b046ef570f64 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:09 user nova-compute[72904]: WARNING nova.compute.manager [req-e4b9d800-9592-4c89-95c8-27f1cb94ebca req-ef6e562d-1284-4563-98eb-b046ef570f64 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state stopped and task_state powering-on.
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113129.8175025, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:09 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Resumed (Lifecycle Event)
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:12:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance rebooted successfully.
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f79f6089-0192-493f-879a-64347bf24e19 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:09 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113129.8194518, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:09 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Started (Lifecycle Event)
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23334303065376461', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334303065376461', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'flavor' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:12:09 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:12:09 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:12:09 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:12:09 user nova-compute[72904]:   <serial>298c326d-516b-4651-b281-e38ee7f73250</serial>
Aug 27 05:12:09 user nova-compute[72904]: </disk>
Aug 27 05:12:09 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:12:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No VIF found with MAC fa:16:3e:4f:23:09, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:12:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfe0fcf3-13ad-42f8-a79d-153e8fc59b89 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.127s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-changed-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Refreshing instance network info cache due to event network-changed-22f4c3df-638a-45cd-8f21-adfe33f65c1a. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:12:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] Acquiring lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] Acquired lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:14 user nova-compute[72904]: DEBUG nova.network.neutron [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Refreshing network info cache for port 22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updated VIF entry in instance network info cache for port 22f4c3df-638a-45cd-8f21-adfe33f65c1a. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updating instance_info_cache with network_info: [{"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f8b7b86-e7c4-4608-967d-5e39e4605567 req-d1cc5030-4f3c-4d51-b5f5-3c8a9a06159f service nova] Releasing lock "refresh_cache-e8403a20-3d6b-4897-b697-fdb1e7722e4f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'flavor' on Instance uuid e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:15 user nova-compute[72904]: INFO nova.compute.manager [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Attaching volume 7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b to /dev/vdb
Aug 27 05:12:15 user nova-compute[72904]: DEBUG os_brick.utils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d622cf49-df1d-4d39-af42-b8a79f8f9c03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0159e7-e39e-4f89-b690-9f3a331fdbca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b696118-c87a-47db-b8ba-aa2183f4e365]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb4814-3e29-4a02-9d8c-0b1921de6a59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:12:15 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:12:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[43812f48-1847-4a1c-a83a-d6dbef487fb4]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG os_brick.utils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updating existing volume attachment record: 1619c30b-afa2-425c-b258-1d93070913c7 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:12:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:16 user nova-compute[72904]: INFO nova.compute.manager [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Unrescuing
Aug 27 05:12:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'flavor' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-5120c5e2-d027-4fb9-a598-e539c96b479d req-1b627baf-79e7-4af0-9323-7ae55c82695d service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-unplugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5120c5e2-d027-4fb9-a598-e539c96b479d req-1b627baf-79e7-4af0-9323-7ae55c82695d service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5120c5e2-d027-4fb9-a598-e539c96b479d req-1b627baf-79e7-4af0-9323-7ae55c82695d service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5120c5e2-d027-4fb9-a598-e539c96b479d req-1b627baf-79e7-4af0-9323-7ae55c82695d service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-5120c5e2-d027-4fb9-a598-e539c96b479d req-1b627baf-79e7-4af0-9323-7ae55c82695d service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-unplugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:17 user nova-compute[72904]: WARNING nova.compute.manager [req-5120c5e2-d027-4fb9-a598-e539c96b479d req-1b627baf-79e7-4af0-9323-7ae55c82695d service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-unplugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:12:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:17 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance destroyed successfully.
Aug 27 05:12:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:19 user nova-compute[72904]: WARNING nova.compute.manager [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:12:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:19 user nova-compute[72904]: WARNING nova.compute.manager [req-76b0a87f-967d-4118-9d75-58bb2d5dca30 req-f3f9fab1-092a-4498-a7e8-06043f3b0ea3 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:12:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 811276f1-7d8e-4b92-9cb0-239ad4121cff due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113141.4463255, 811276f1-7d8e-4b92-9cb0-239ad4121cff => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] VM Resumed (Lifecycle Event)
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a244075c-140c-4dc1-ade0-11585f0e78c6 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113141.4479868, 811276f1-7d8e-4b92-9cb0-239ad4121cff => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] VM Started (Lifecycle Event)
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-980a6e2d-d1b5-44b7-8841-5f35b3c90bf9 req-cb5cccab-b1a3-4bc2-a6e1-a98ed72bc3ee service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-980a6e2d-d1b5-44b7-8841-5f35b3c90bf9 req-cb5cccab-b1a3-4bc2-a6e1-a98ed72bc3ee service nova] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-980a6e2d-d1b5-44b7-8841-5f35b3c90bf9 req-cb5cccab-b1a3-4bc2-a6e1-a98ed72bc3ee service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-980a6e2d-d1b5-44b7-8841-5f35b3c90bf9 req-cb5cccab-b1a3-4bc2-a6e1-a98ed72bc3ee service nova] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-980a6e2d-d1b5-44b7-8841-5f35b3c90bf9 req-cb5cccab-b1a3-4bc2-a6e1-a98ed72bc3ee service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] No waiting events found dispatching network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:21 user nova-compute[72904]: WARNING nova.compute.manager [req-980a6e2d-d1b5-44b7-8841-5f35b3c90bf9 req-cb5cccab-b1a3-4bc2-a6e1-a98ed72bc3ee service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received unexpected event network-vif-plugged-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 for instance with vm_state active and task_state None.
Aug 27 05:12:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing instance network info cache due to event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:12:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] Acquiring lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] Acquired lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:12:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updated VIF entry in instance network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:12:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-07299466-9bb0-4d61-b15c-2158adc174ec req-3e6fc189-9859-468e-ae99-2d6587207331 service nova] Releasing lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing instance network info cache due to event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:12:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] Acquiring lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] Acquired lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:27 user nova-compute[72904]: DEBUG nova.network.neutron [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG nova.network.neutron [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updated VIF entry in instance network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG nova.network.neutron [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f1fc6483-5fd7-4245-a51a-3987d9c52ba9 req-462e3135-22ca-4057-8b97-a5a9c8a7e815 service nova] Releasing lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:28 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:28 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:28 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d169f79-e008-4608-9ea7-55c3db237828]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:12:28 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb150201-6ad4-446c-981a-8cbfd15fb4fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b] added
Aug 27 05:12:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bde872-16a5-47a8-bb86-a0b6dfdeed62]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ecbca5-4d92-43a3-9776-b9b1ce8d94d0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgopYayh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgopYayh" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b489c-7de2-484f-a7aa-0d2f084569b9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgopYayh'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb78000-3481-4115-a456-1aed49b1c6ee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05a37b5-482a-49d4-ac40-018c26a298db]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:28 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:28 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[997decbd-3412-4267-a739-4e8579a0f986]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]
Aug 27 05:12:28 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.
Aug 27 05:12:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77758881-131f-4ebb-8d17-b04ea8b72d7f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a589e1a7-5687-45f3-acb3-4373f03f4960]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:28 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:28 user nova-compute[72904]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:28 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:28 user nova-compute[72904]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51551b9-06dc-4c46-8a10-fe6dabd0757e]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:12:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23039313038313162', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313038313162', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'flavor' on Instance uuid e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:12:29 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:12:29 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:12:29 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:12:29 user nova-compute[72904]:   <serial>7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b</serial>
Aug 27 05:12:29 user nova-compute[72904]: </disk>
Aug 27 05:12:29 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No VIF found with MAC fa:16:3e:af:c5:7b, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba1e7c83-a38a-4d35-921f-dc23f1597125 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.779s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:31 user nova-compute[72904]: INFO nova.compute.manager [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Rebuilding instance
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-376f5ae7-efbc-481e-a98d-9870ead76f8e req-917211f3-4130-43ef-9ae3-9689c5dea443 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-unplugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-376f5ae7-efbc-481e-a98d-9870ead76f8e req-917211f3-4130-43ef-9ae3-9689c5dea443 service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-376f5ae7-efbc-481e-a98d-9870ead76f8e req-917211f3-4130-43ef-9ae3-9689c5dea443 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-376f5ae7-efbc-481e-a98d-9870ead76f8e req-917211f3-4130-43ef-9ae3-9689c5dea443 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-376f5ae7-efbc-481e-a98d-9870ead76f8e req-917211f3-4130-43ef-9ae3-9689c5dea443 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-unplugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:32 user nova-compute[72904]: WARNING nova.compute.manager [req-376f5ae7-efbc-481e-a98d-9870ead76f8e req-917211f3-4130-43ef-9ae3-9689c5dea443 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received unexpected event network-vif-unplugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with vm_state active and task_state rebuilding.
Aug 27 05:12:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance destroyed successfully.
Aug 27 05:12:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7313MB free_disk=25.354976654052734GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:33 user nova-compute[72904]: INFO nova.compute.manager [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Detaching volume 7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12852d71-dd0e-46da-8b7b-674551d62f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e8403a20-3d6b-4897-b697-fdb1e7722e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:12:33 user nova-compute[72904]: INFO nova.virt.block_device [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Attempting to driver detach volume 7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b from mountpoint /dev/vdb
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Attempting to detach device vdb from instance e8403a20-3d6b-4897-b697-fdb1e7722e4f from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:12:33 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:12:33 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:12:33 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:12:33 user nova-compute[72904]:   <serial>7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b</serial>
Aug 27 05:12:33 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:12:33 user nova-compute[72904]: </disk>
Aug 27 05:12:33 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:12:33 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully detached device vdb from instance e8403a20-3d6b-4897-b697-fdb1e7722e4f from the persistent domain config.
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:33 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb61326-a85f-4b2b-b1e3-f14b624db907]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[25baf523-f5e5-4141-adb6-938b6ec064e1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:33 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:33 user nova-compute[72904]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:33 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:33 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:33 user nova-compute[72904]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:33 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c5b2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dbf27c-32c6-428b-b3e3-72538419c141]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c75661-dad9-40a6-afce-771ac69c4e00]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5689495c-014e-48ff-b3e0-cd63421303f9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc79bb9-b304-44dc-8087-424d8cedc138]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4ad705-1b39-464b-a75b-b3b4ecb8f134]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[55487150-3691-493c-9abe-afee1d2cb316]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]
Aug 27 05:12:33 user nova-compute[72904]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.
Aug 27 05:12:33 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524a420-a820-4fab-bdf5-820d3c6f108a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== disconnect_volume: return (291ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-15ee342c-1cbd-4c7a-bb07-8087ac3cfa21 req-26aea46c-5836-4189-ba5c-dde82bdaab5c service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-15ee342c-1cbd-4c7a-bb07-8087ac3cfa21 req-26aea46c-5836-4189-ba5c-dde82bdaab5c service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-15ee342c-1cbd-4c7a-bb07-8087ac3cfa21 req-26aea46c-5836-4189-ba5c-dde82bdaab5c service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-15ee342c-1cbd-4c7a-bb07-8087ac3cfa21 req-26aea46c-5836-4189-ba5c-dde82bdaab5c service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-15ee342c-1cbd-4c7a-bb07-8087ac3cfa21 req-26aea46c-5836-4189-ba5c-dde82bdaab5c service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:34 user nova-compute[72904]: WARNING nova.compute.manager [req-15ee342c-1cbd-4c7a-bb07-8087ac3cfa21 req-26aea46c-5836-4189-ba5c-dde82bdaab5c service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received unexpected event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with vm_state active and task_state rebuilding.
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:34 user nova-compute[72904]: INFO nova.compute.manager [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Unshelving
Aug 27 05:12:34 user nova-compute[72904]: INFO nova.virt.block_device [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Booting with volume 8fdc8739-5ca2-400b-9c9b-605dd162c22f at /dev/vdc
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.utils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af94d2e-34f6-408f-b93f-cdccd38486e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd2211-016b-421f-b9a2-b5a4fb05e8bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:34 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance destroyed successfully.
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1345860853',display_name='tempest-ServerActionsTestOtherA-server-519660922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1345860853',id=25,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++BiDN+mUiQdqNo4heN++I25Vk6uDCgkOxauU/iskeWbKK2dvwTPa++12IJ1pqvVfHSF/xobaW93KJ6Uqd5KTLkpkHWhOW9ylpRKGUXozXUiC4bSWMwZQerq2l/iY7og==',key_name='tempest-keypair-1714509772',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-mk08pdxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:12:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=e8403a20-3d6b-4897-b697-fdb1e7722e4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_vif [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22f4c3df-63, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:12:34 user nova-compute[72904]: INFO os_vif [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63')
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2929e9c-cb2f-44f6-8110-36cdac3d60dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b65c60-0819-4e58-823a-20cc98e0c410]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:34 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:12:34 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc4b7f4-51f2-4908-91b1-fa20011b955a]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.utils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating existing volume attachment record: 62255da6-07d0-4792-8f46-8ef966bc52c0 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45624c2-f2a2-456d-b2a0-8101fdee6b9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9682e86-0509-4c60-bc3b-5a72cb6d9e1d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:34 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:34 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194537f40>, {}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Disconnecting from: [] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== disconnect_volume: return (65ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:12:34 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Deleting instance files /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f_del
Aug 27 05:12:34 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Deletion of /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f_del complete
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:12:35 user nova-compute[72904]: INFO nova.virt.block_device [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Booting with volume 7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b at /dev/vdb
Aug 27 05:12:35 user nova-compute[72904]: DEBUG os_brick.utils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d702aed2-f758-49ee-bb66-f67f1ff0e766]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1829214d-cf59-4781-a3c6-13c6a6f04715]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[932e584e-33c0-4573-89e3-a14117850dad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9df3636-dce0-4c81-b9ad-bd7b92fbbfc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:12:35 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c2125f-e467-498a-b5a5-465277debf45]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG os_brick.utils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updating existing volume attachment record: b78102f8-a7de-4e56-ace6-e97b340e0ec4 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updating instance_info_cache with network_info: [{"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:36 user nova-compute[72904]: INFO nova.compute.manager [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Rebooting instance
Aug 27 05:12:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquired lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Releasing lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-60da4fc1-19df-41d2-8672-6bf93adeb23d req-b7147de1-ef48-4dd1-89d7-48cc2ee859ea service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-unplugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60da4fc1-19df-41d2-8672-6bf93adeb23d req-b7147de1-ef48-4dd1-89d7-48cc2ee859ea service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60da4fc1-19df-41d2-8672-6bf93adeb23d req-b7147de1-ef48-4dd1-89d7-48cc2ee859ea service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60da4fc1-19df-41d2-8672-6bf93adeb23d req-b7147de1-ef48-4dd1-89d7-48cc2ee859ea service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-60da4fc1-19df-41d2-8672-6bf93adeb23d req-b7147de1-ef48-4dd1-89d7-48cc2ee859ea service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-unplugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:37 user nova-compute[72904]: WARNING nova.compute.manager [req-60da4fc1-19df-41d2-8672-6bf93adeb23d req-b7147de1-ef48-4dd1-89d7-48cc2ee859ea service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received unexpected event network-vif-unplugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 05:12:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:37 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance destroyed successfully.
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'resources' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-154298842',display_name='tempest-TestMinimumBasicScenario-server-154298842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-154298842',id=24,image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmC2e4T98duKpEp83AKEXonLXloh9t/Zb4XOyE6f2eNex/52u+CTWLoC4QbEk/hmnUlfYO/JWFIvfdStE4ntnvvJR4gBuBWUix8fpcaPWlkcm+9eIqAhKBstI+lWg7Cnw==',key_name='tempest-TestMinimumBasicScenario-1793810962',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-09cesfte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:12:37Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=12852d71-dd0e-46da-8b7b-674551d62f3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_vif [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a8c4683-48, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:37 user nova-compute[72904]: INFO os_vif [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48')
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRctPSly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:37 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c7817c-5148-4362-a40c-fe37f9cc49b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5876e6-0d19-4b9f-bb74-73960516ffd6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:37 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:37 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:37 user nova-compute[72904]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:37 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c5d2170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0fc5c0-0bbe-4ca8-b5b8-12508b8997b3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9235fbd1-415b-452f-9583-088b429b29de]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8033b71-c00e-4d28-b30a-60b1e14d30f6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b08c88-3c75-4767-b381-53501189802f]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4436f9fe-ab8b-447f-b4e6-4f2944aa1580]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca78fa-de2e-4271-86a3-9799eb524da9]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]
Aug 27 05:12:37 user nova-compute[72904]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.
Aug 27 05:12:37 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cf581f-ec96-4cc0-921f-e1f2b3258b87]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== disconnect_volume: return (260ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Start _get_guest_xml network_info=[{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c26b4ffb-f0cc-4857-9219-ede3f13a1373', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRctPSly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '12852d71-dd0e-46da-8b7b-674551d62f3c', 'attached_at': '', 'detached_at': '', 'volume_id': '298c326d-516b-4651-b281-e38ee7f73250', 'serial': '298c326d-516b-4651-b281-e38ee7f73250'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:12:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:37 user nova-compute[72904]: DEBUG nova.objects.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Object Instance<12852d71-dd0e-46da-8b7b-674551d62f3c> lazy-loaded attributes: resources,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRctPSly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:38 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:38 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:38 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431dce1-fcdc-4e10-b7d7-edd1a27689f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:12:38 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2510fd53-78cb-4bfe-8294-7cd6fec21eda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250] added
Aug 27 05:12:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d2ac54-f782-4e05-9363-6df5b453a79e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[50942f82-3814-451c-87ad-334593e46600]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRctPSly {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRctPSly" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[732d6939-23af-4ec3-b019-cec6d909a7c1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kRctPSly'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f102817f-9d17-4fe5-b34b-b009b61d5de3]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aa6353-4b1e-4b02-a6cd-992ea1110f02]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[31268050-d7e7-440c-93ac-9177e1794628]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]
Aug 27 05:12:38 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.
Aug 27 05:12:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf1d3bf-b4d6-4b82-b4b2-4eb322e547a8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc53817-4d82-4196-9f63-01fd238db870]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:38 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:38 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2942ad-e5b5-4573-9963-aabf3d87dbd8]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:12:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRctPSly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-e0478c45-8261-4565-92f4-22059daa588d req-bfbbe4aa-4f32-4b6c-a7c2-d51254cc1fbe service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e0478c45-8261-4565-92f4-22059daa588d req-bfbbe4aa-4f32-4b6c-a7c2-d51254cc1fbe service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e0478c45-8261-4565-92f4-22059daa588d req-bfbbe4aa-4f32-4b6c-a7c2-d51254cc1fbe service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e0478c45-8261-4565-92f4-22059daa588d req-bfbbe4aa-4f32-4b6c-a7c2-d51254cc1fbe service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-e0478c45-8261-4565-92f4-22059daa588d req-bfbbe4aa-4f32-4b6c-a7c2-d51254cc1fbe service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:39 user nova-compute[72904]: WARNING nova.compute.manager [req-e0478c45-8261-4565-92f4-22059daa588d req-bfbbe4aa-4f32-4b6c-a7c2-d51254cc1fbe service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received unexpected event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 05:12:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23334303065376461', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334303065376461', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-154298842',display_name='tempest-TestMinimumBasicScenario-server-154298842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-154298842',id=24,image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmC2e4T98duKpEp83AKEXonLXloh9t/Zb4XOyE6f2eNex/52u+CTWLoC4QbEk/hmnUlfYO/JWFIvfdStE4ntnvvJR4gBuBWUix8fpcaPWlkcm+9eIqAhKBstI+lWg7Cnw==',key_name='tempest-TestMinimumBasicScenario-1793810962',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-09cesfte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:12:37Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=12852d71-dd0e-46da-8b7b-674551d62f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'pci_devices' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.objects.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Object Instance<12852d71-dd0e-46da-8b7b-674551d62f3c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:12:39 user nova-compute[72904]:   <uuid>12852d71-dd0e-46da-8b7b-674551d62f3c</uuid>
Aug 27 05:12:39 user nova-compute[72904]:   <name>instance-00000018</name>
Aug 27 05:12:39 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:12:39 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:12:39 user nova-compute[72904]:   <metadata>
Aug 27 05:12:39 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:12:39 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:12:39 user nova-compute[72904]:       <nova:name>tempest-TestMinimumBasicScenario-server-154298842</nova:name>
Aug 27 05:12:39 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:12:37</nova:creationTime>
Aug 27 05:12:39 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:12:39 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:12:39 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:12:39 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:12:39 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:12:39 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:12:39 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:12:39 user nova-compute[72904]:       <nova:owner>
Aug 27 05:12:39 user nova-compute[72904]:         <nova:user uuid="bc32ad60b20c47f6a7790a8d28bb03dc">tempest-TestMinimumBasicScenario-216754606-project-member</nova:user>
Aug 27 05:12:39 user nova-compute[72904]:         <nova:project uuid="9850ebbdbc8d4081ba11931417e4d96b">tempest-TestMinimumBasicScenario-216754606</nova:project>
Aug 27 05:12:39 user nova-compute[72904]:       </nova:owner>
Aug 27 05:12:39 user nova-compute[72904]:       <nova:root type="image" uuid="0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0"/>
Aug 27 05:12:39 user nova-compute[72904]:       <nova:ports>
Aug 27 05:12:39 user nova-compute[72904]:         <nova:port uuid="9a8c4683-4885-4a6e-8832-bf0bb7d96111">
Aug 27 05:12:39 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 05:12:39 user nova-compute[72904]:         </nova:port>
Aug 27 05:12:39 user nova-compute[72904]:       </nova:ports>
Aug 27 05:12:39 user nova-compute[72904]:     </nova:instance>
Aug 27 05:12:39 user nova-compute[72904]:   </metadata>
Aug 27 05:12:39 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:12:39 user nova-compute[72904]:     <system>
Aug 27 05:12:39 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:12:39 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:12:39 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:12:39 user nova-compute[72904]:       <entry name="serial">12852d71-dd0e-46da-8b7b-674551d62f3c</entry>
Aug 27 05:12:39 user nova-compute[72904]:       <entry name="uuid">12852d71-dd0e-46da-8b7b-674551d62f3c</entry>
Aug 27 05:12:39 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:12:39 user nova-compute[72904]:     </system>
Aug 27 05:12:39 user nova-compute[72904]:   </sysinfo>
Aug 27 05:12:39 user nova-compute[72904]:   <os>
Aug 27 05:12:39 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:12:39 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:12:39 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:12:39 user nova-compute[72904]:   </os>
Aug 27 05:12:39 user nova-compute[72904]:   <features>
Aug 27 05:12:39 user nova-compute[72904]:     <acpi/>
Aug 27 05:12:39 user nova-compute[72904]:     <apic/>
Aug 27 05:12:39 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:12:39 user nova-compute[72904]:   </features>
Aug 27 05:12:39 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:12:39 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:12:39 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:12:39 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:12:39 user nova-compute[72904]:   </clock>
Aug 27 05:12:39 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:12:39 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:12:39 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:12:39 user nova-compute[72904]:   </cpu>
Aug 27 05:12:39 user nova-compute[72904]:   <devices>
Aug 27 05:12:39 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:12:39 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:12:39 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk"/>
Aug 27 05:12:39 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:12:39 user nova-compute[72904]:     </disk>
Aug 27 05:12:39 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:12:39 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:12:39 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:12:39 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:12:39 user nova-compute[72904]:       <serial>298c326d-516b-4651-b281-e38ee7f73250</serial>
Aug 27 05:12:39 user nova-compute[72904]:     </disk>
Aug 27 05:12:39 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:12:39 user nova-compute[72904]:       <mac address="fa:16:3e:4f:23:09"/>
Aug 27 05:12:39 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:39 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:12:39 user nova-compute[72904]:       <target dev="tap9a8c4683-48"/>
Aug 27 05:12:39 user nova-compute[72904]:     </interface>
Aug 27 05:12:39 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:12:39 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/console.log" append="off"/>
Aug 27 05:12:39 user nova-compute[72904]:     </serial>
Aug 27 05:12:39 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:12:39 user nova-compute[72904]:     <video>
Aug 27 05:12:39 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:39 user nova-compute[72904]:     </video>
Aug 27 05:12:39 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:12:39 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:12:39 user nova-compute[72904]:     </rng>
Aug 27 05:12:39 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:12:39 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:12:39 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:12:39 user nova-compute[72904]:     </memballoon>
Aug 27 05:12:39 user nova-compute[72904]:   </devices>
Aug 27 05:12:39 user nova-compute[72904]: </domain>
Aug 27 05:12:39 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'trusted_certs' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.objects.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Object Instance<12852d71-dd0e-46da-8b7b-674551d62f3c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:12:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Cannot resize image /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'migration_context' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG nova.objects.base [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Object Instance<12852d71-dd0e-46da-8b7b-674551d62f3c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-154298842',display_name='tempest-TestMinimumBasicScenario-server-154298842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-154298842',id=24,image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmC2e4T98duKpEp83AKEXonLXloh9t/Zb4XOyE6f2eNex/52u+CTWLoC4QbEk/hmnUlfYO/JWFIvfdStE4ntnvvJR4gBuBWUix8fpcaPWlkcm+9eIqAhKBstI+lWg7Cnw==',key_name='tempest-TestMinimumBasicScenario-1793810962',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-09cesfte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:12:37Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=12852d71-dd0e-46da-8b7b-674551d62f3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG os_vif [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a8c4683-48, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a8c4683-48, col_values=(('external_ids', {'iface-id': '9a8c4683-4885-4a6e-8832-bf0bb7d96111', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:23:09', 'vm-uuid': '12852d71-dd0e-46da-8b7b-674551d62f3c'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:12:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:40 user nova-compute[72904]: INFO os_vif [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48')
Aug 27 05:12:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e2e6672-3c60-4a35-b918-d7e3a942dd9f req-78b6a772-d2b4-4f27-af72-33e56a787370 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e2e6672-3c60-4a35-b918-d7e3a942dd9f req-78b6a772-d2b4-4f27-af72-33e56a787370 service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e2e6672-3c60-4a35-b918-d7e3a942dd9f req-78b6a772-d2b4-4f27-af72-33e56a787370 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e2e6672-3c60-4a35-b918-d7e3a942dd9f req-78b6a772-d2b4-4f27-af72-33e56a787370 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e2e6672-3c60-4a35-b918-d7e3a942dd9f req-78b6a772-d2b4-4f27-af72-33e56a787370 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:41 user nova-compute[72904]: WARNING nova.compute.manager [req-8e2e6672-3c60-4a35-b918-d7e3a942dd9f req-78b6a772-d2b4-4f27-af72-33e56a787370 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received unexpected event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 05:12:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 12852d71-dd0e-46da-8b7b-674551d62f3c due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113163.6570327, 12852d71-dd0e-46da-8b7b-674551d62f3c => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:43 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] VM Resumed (Lifecycle Event)
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:12:43 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance rebooted successfully.
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:43 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113163.6579778, 12852d71-dd0e-46da-8b7b-674551d62f3c => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:43 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] VM Started (Lifecycle Event)
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-890dc8d2-d33d-4a92-b89c-9f4e75f16c56 req-a571a395-4395-4812-acbc-cc8bb0631f74 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-890dc8d2-d33d-4a92-b89c-9f4e75f16c56 req-a571a395-4395-4812-acbc-cc8bb0631f74 service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-890dc8d2-d33d-4a92-b89c-9f4e75f16c56 req-a571a395-4395-4812-acbc-cc8bb0631f74 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-890dc8d2-d33d-4a92-b89c-9f4e75f16c56 req-a571a395-4395-4812-acbc-cc8bb0631f74 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-890dc8d2-d33d-4a92-b89c-9f4e75f16c56 req-a571a395-4395-4812-acbc-cc8bb0631f74 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:43 user nova-compute[72904]: WARNING nova.compute.manager [req-890dc8d2-d33d-4a92-b89c-9f4e75f16c56 req-a571a395-4395-4812-acbc-cc8bb0631f74 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received unexpected event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with vm_state active and task_state reboot_started_hard.
Aug 27 05:12:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1c2d8635-d4ba-47fe-82a2-721950bd056b tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.610s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'pci_requests' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'numa_topology' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:12:47 user nova-compute[72904]: INFO nova.compute.claims [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Claim successful on node user
Aug 27 05:12:47 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:47 user nova-compute[72904]: INFO nova.network.neutron [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating port 3874404d-4f70-43f4-b56b-5d7368b97827 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:12:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Creating image(s)
Aug 27 05:12:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk 1073741824" returned: 0 in 0.052s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113153.0034757, e8403a20-3d6b-4897-b697-fdb1e7722e4f => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:48 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] VM Stopped (Lifecycle Event)
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c6bf1fcb-69c5-4d2a-9e19-77f7a9d9213c None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquired lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing instance network info cache due to event network-changed-3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] Acquiring lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Cannot resize image /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Ensure instance console log exists: /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Start _get_guest_xml network_info=[{"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b78102f8-a7de-4e56-ace6-e97b340e0ec4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8403a20-3d6b-4897-b697-fdb1e7722e4f', 'attached_at': '', 'detached_at': '', 'volume_id': '7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b', 'serial': '7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:12:48 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 05:12:48 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'vcpu_model' on Instance uuid e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:48 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:48 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:48 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[362bcf89-f84b-4269-a3b1-e815a3bd1f4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:12:48 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e70be8-e713-4b28-802f-6c7f5aee608d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b] added
Aug 27 05:12:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb36efb-096f-4758-9953-151c06f05f84]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb09aaaa-8eae-4495-a073-b4ad3d7b668d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgopYayh {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgopYayh" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5e21ff-8635-44eb-954c-e408544dedf1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgopYayh'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b9d33-3d6c-4a0c-9e04-af792417de50]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ce5c0c-c1c2-4c79-8e5c-f8bb4ee4683a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:48 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:48 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20942f-c5be-43cb-8f09-cdd7667d3bb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]
Aug 27 05:12:49 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.
Aug 27 05:12:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[27223e71-4c15-4569-a914-6b39d6836523]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Releasing lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:12:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Creating image(s)
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'trusted_certs' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff254ffd-4643-40e1-84a2-0e33598421bb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] Acquired lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG nova.network.neutron [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Refreshing network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:49 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:49 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:49 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:49 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60d82ed-4c1d-4bd6-94ea-462343ff4c9b]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG nova.objects.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<f8dad8d9-a024-4f25-b1fa-52424b79b662> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "5823abeb3dfd275266fb95733e4b4fa2a39827dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "5823abeb3dfd275266fb95733e4b4fa2a39827dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.592s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== connect_volume: return (1595ms) {'type': 'block', 'scsi_wwn': '23039313038313162', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039313038313162', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1345860853',display_name='tempest-ServerActionsTestOtherA-server-519660922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1345860853',id=25,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++BiDN+mUiQdqNo4heN++I25Vk6uDCgkOxauU/iskeWbKK2dvwTPa++12IJ1pqvVfHSF/xobaW93KJ6Uqd5KTLkpkHWhOW9ylpRKGUXozXUiC4bSWMwZQerq2l/iY7og==',key_name='tempest-keypair-1714509772',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-mk08pdxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=e8403a20-3d6b-4897-b697-fdb1e7722e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:12:50 user nova-compute[72904]:   <uuid>e8403a20-3d6b-4897-b697-fdb1e7722e4f</uuid>
Aug 27 05:12:50 user nova-compute[72904]:   <name>instance-00000019</name>
Aug 27 05:12:50 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:12:50 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:12:50 user nova-compute[72904]:   <metadata>
Aug 27 05:12:50 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:12:50 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:12:50 user nova-compute[72904]:       <nova:name>tempest-ServerActionsTestOtherA-server-519660922</nova:name>
Aug 27 05:12:50 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:12:48</nova:creationTime>
Aug 27 05:12:50 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:12:50 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:12:50 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:12:50 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:12:50 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:12:50 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:12:50 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:12:50 user nova-compute[72904]:       <nova:owner>
Aug 27 05:12:50 user nova-compute[72904]:         <nova:user uuid="14df3bfebe7c43dca0a4ef2ee90f995b">tempest-ServerActionsTestOtherA-886850923-project-member</nova:user>
Aug 27 05:12:50 user nova-compute[72904]:         <nova:project uuid="a553916b16f8404ca042ad82b503e6c7">tempest-ServerActionsTestOtherA-886850923</nova:project>
Aug 27 05:12:50 user nova-compute[72904]:       </nova:owner>
Aug 27 05:12:50 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:12:50 user nova-compute[72904]:       <nova:ports>
Aug 27 05:12:50 user nova-compute[72904]:         <nova:port uuid="22f4c3df-638a-45cd-8f21-adfe33f65c1a">
Aug 27 05:12:50 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 05:12:50 user nova-compute[72904]:         </nova:port>
Aug 27 05:12:50 user nova-compute[72904]:       </nova:ports>
Aug 27 05:12:50 user nova-compute[72904]:     </nova:instance>
Aug 27 05:12:50 user nova-compute[72904]:   </metadata>
Aug 27 05:12:50 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:12:50 user nova-compute[72904]:     <system>
Aug 27 05:12:50 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:12:50 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:12:50 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:12:50 user nova-compute[72904]:       <entry name="serial">e8403a20-3d6b-4897-b697-fdb1e7722e4f</entry>
Aug 27 05:12:50 user nova-compute[72904]:       <entry name="uuid">e8403a20-3d6b-4897-b697-fdb1e7722e4f</entry>
Aug 27 05:12:50 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:12:50 user nova-compute[72904]:     </system>
Aug 27 05:12:50 user nova-compute[72904]:   </sysinfo>
Aug 27 05:12:50 user nova-compute[72904]:   <os>
Aug 27 05:12:50 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:12:50 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:12:50 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:12:50 user nova-compute[72904]:   </os>
Aug 27 05:12:50 user nova-compute[72904]:   <features>
Aug 27 05:12:50 user nova-compute[72904]:     <acpi/>
Aug 27 05:12:50 user nova-compute[72904]:     <apic/>
Aug 27 05:12:50 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:12:50 user nova-compute[72904]:   </features>
Aug 27 05:12:50 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:12:50 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:12:50 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:12:50 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:12:50 user nova-compute[72904]:   </clock>
Aug 27 05:12:50 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:12:50 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:12:50 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:12:50 user nova-compute[72904]:   </cpu>
Aug 27 05:12:50 user nova-compute[72904]:   <devices>
Aug 27 05:12:50 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:12:50 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:12:50 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk"/>
Aug 27 05:12:50 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:12:50 user nova-compute[72904]:     </disk>
Aug 27 05:12:50 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:12:50 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:12:50 user nova-compute[72904]:       <source dev="/dev/sdd"/>
Aug 27 05:12:50 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:12:50 user nova-compute[72904]:       <serial>7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b</serial>
Aug 27 05:12:50 user nova-compute[72904]:     </disk>
Aug 27 05:12:50 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:12:50 user nova-compute[72904]:       <mac address="fa:16:3e:af:c5:7b"/>
Aug 27 05:12:50 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:50 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:12:50 user nova-compute[72904]:       <target dev="tap22f4c3df-63"/>
Aug 27 05:12:50 user nova-compute[72904]:     </interface>
Aug 27 05:12:50 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:12:50 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/console.log" append="off"/>
Aug 27 05:12:50 user nova-compute[72904]:     </serial>
Aug 27 05:12:50 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:12:50 user nova-compute[72904]:     <video>
Aug 27 05:12:50 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:50 user nova-compute[72904]:     </video>
Aug 27 05:12:50 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:12:50 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:12:50 user nova-compute[72904]:     </rng>
Aug 27 05:12:50 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:12:50 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:12:50 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:12:50 user nova-compute[72904]:     </memballoon>
Aug 27 05:12:50 user nova-compute[72904]:   </devices>
Aug 27 05:12:50 user nova-compute[72904]: </domain>
Aug 27 05:12:50 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1345860853',display_name='tempest-ServerActionsTestOtherA-server-519660922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1345860853',id=25,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++BiDN+mUiQdqNo4heN++I25Vk6uDCgkOxauU/iskeWbKK2dvwTPa++12IJ1pqvVfHSF/xobaW93KJ6Uqd5KTLkpkHWhOW9ylpRKGUXozXUiC4bSWMwZQerq2l/iY7og==',key_name='tempest-keypair-1714509772',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-mk08pdxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=e8403a20-3d6b-4897-b697-fdb1e7722e4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG os_vif [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22f4c3df-63, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22f4c3df-63, col_values=(('external_ids', {'iface-id': '22f4c3df-638a-45cd-8f21-adfe33f65c1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:c5:7b', 'vm-uuid': 'e8403a20-3d6b-4897-b697-fdb1e7722e4f'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:50 user nova-compute[72904]: INFO os_vif [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63')
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No VIF found with MAC fa:16:3e:af:c5:7b, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.part --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.virt.images [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] 7c11121c-dcd3-4da1-9163-f72105fe9ea7 was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.part /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updated VIF entry in instance network info cache for port 3874404d-4f70-43f4-b56b-5d7368b97827. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5e491466-58df-4ef7-98b0-e7a4186a473a req-66d946ec-b24a-48a6-b89c-cd7928f41830 service nova] Releasing lock "refresh_cache-f8dad8d9-a024-4f25-b1fa-52424b79b662" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.part /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.converted" returned: 0 in 0.385s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:50 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "5823abeb3dfd275266fb95733e4b4fa2a39827dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.987s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "5823abeb3dfd275266fb95733e4b4fa2a39827dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "5823abeb3dfd275266fb95733e4b4fa2a39827dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd,backing_fmt=raw /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd,backing_fmt=raw /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk 1073741824" returned: 0 in 0.061s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "5823abeb3dfd275266fb95733e4b4fa2a39827dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'migration_context' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG nova.objects.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<f8dad8d9-a024-4f25-b1fa-52424b79b662> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Rebasing disk image.
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 -F raw /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b9d84ff-1c87-4abc-99f8-63b7b5929186 req-e464b134-9aca-4696-a909-52a6895e0c2c service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b9d84ff-1c87-4abc-99f8-63b7b5929186 req-e464b134-9aca-4696-a909-52a6895e0c2c service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b9d84ff-1c87-4abc-99f8-63b7b5929186 req-e464b134-9aca-4696-a909-52a6895e0c2c service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b9d84ff-1c87-4abc-99f8-63b7b5929186 req-e464b134-9aca-4696-a909-52a6895e0c2c service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b9d84ff-1c87-4abc-99f8-63b7b5929186 req-e464b134-9aca-4696-a909-52a6895e0c2c service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:52 user nova-compute[72904]: WARNING nova.compute.manager [req-6b9d84ff-1c87-4abc-99f8-63b7b5929186 req-e464b134-9aca-4696-a909-52a6895e0c2c service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received unexpected event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with vm_state active and task_state rebuild_spawning.
Aug 27 05:12:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113173.915831, e8403a20-3d6b-4897-b697-fdb1e7722e4f => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:53 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] VM Resumed (Lifecycle Event)
Aug 27 05:12:53 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance spawned successfully.
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 -F raw /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk" returned: 0 in 2.051s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Ensure instance console log exists: /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Start _get_guest_xml network_info=[{"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='640fe1cce5877bdb48564523203c50ad',container_format='bare',created_at=2023-08-27T05:10:41Z,direct_url=<?>,disk_format='qcow2',id=7c11121c-dcd3-4da1-9163-f72105fe9ea7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-413967328-shelved',owner='0fc9180eede040eaa688e81896d5c3c4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T05:10:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '62255da6-07d0-4792-8f46-8ef966bc52c0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neaJclXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'f8dad8d9-a024-4f25-b1fa-52424b79b662', 'attached_at': '', 'detached_at': '', 'volume_id': '8fdc8739-5ca2-400b-9c9b-605dd162c22f', 'serial': '8fdc8739-5ca2-400b-9c9b-605dd162c22f'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:12:54 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113173.917732, e8403a20-3d6b-4897-b697-fdb1e7722e4f => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:54 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] VM Started (Lifecycle Event)
Aug 27 05:12:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='640fe1cce5877bdb48564523203c50ad',container_format='bare',created_at=2023-08-27T05:10:41Z,direct_url=<?>,disk_format='qcow2',id=7c11121c-dcd3-4da1-9163-f72105fe9ea7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-413967328-shelved',owner='0fc9180eede040eaa688e81896d5c3c4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T05:10:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'vcpu_model' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.objects.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<f8dad8d9-a024-4f25-b1fa-52424b79b662> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neaJclXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:12:54 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:54 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:12:54 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-ed6a2006-359e-4f7b-a053-44dd9b735d5d req-8b88c2c0-5b61-4d0d-9869-6579299810f4 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ed6a2006-359e-4f7b-a053-44dd9b735d5d req-8b88c2c0-5b61-4d0d-9869-6579299810f4 service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ed6a2006-359e-4f7b-a053-44dd9b735d5d req-8b88c2c0-5b61-4d0d-9869-6579299810f4 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ed6a2006-359e-4f7b-a053-44dd9b735d5d req-8b88c2c0-5b61-4d0d-9869-6579299810f4 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-ed6a2006-359e-4f7b-a053-44dd9b735d5d req-8b88c2c0-5b61-4d0d-9869-6579299810f4 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:54 user nova-compute[72904]: WARNING nova.compute.manager [req-ed6a2006-359e-4f7b-a053-44dd9b735d5d req-8b88c2c0-5b61-4d0d-9869-6579299810f4 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received unexpected event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with vm_state active and task_state rebuild_spawning.
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e8cbe-750f-4ed6-859b-aaf36292cc38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:12:54 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[13232944-30a3-4e2d-88fb-f6ef55de3d66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f] added
Aug 27 05:12:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72904) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[36448ec8-c299-479b-baa8-5ddc40735f5d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[968f2791-259c-4d4c-aede-ad32da3c9d92]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v neaJclXf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v neaJclXf" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfeba00-5c46-4bc3-93c6-5570cd516b26]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'neaJclXf'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50fcd3-5a2f-4e55-aabb-4dc1506d3024]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dfaf32c1-bc9c-4c0c-bae4-f64befe33d11 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.106s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c75ca3a-9b52-4eac-9b93-87abfe8283aa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[50958c21-af8d-45ec-8507-da7f7b73bda5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260]
Aug 27 05:12:54 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260] successful.
Aug 27 05:12:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa75a5ca-1fed-46a5-8fb5-f332bc70e214]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7025fe23-d74a-4f06-90a4-d8e9afc81001]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:12:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:12:54 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:12:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.518s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8551e563-994f-4564-a308-42923fba12bc]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:12:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neaJclXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.569s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] <== connect_volume: return (1571ms) {'type': 'block', 'scsi_wwn': '26632336430393462', 'path': '/dev/sde'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632336430393462', 'path': '/dev/sde'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-413967328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-413967328',id=23,image_ref='7c11121c-dcd3-4da1-9163-f72105fe9ea7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-272173837',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-gy814sik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member',shelved_at='2023-08-27T05:10:45.647294',shelved_host='user',shelved_image_id='7c11121c-dcd3-4da1-9163-f72105fe9ea7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=f8dad8d9-a024-4f25-b1fa-52424b79b662,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'pci_devices' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.objects.base [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<f8dad8d9-a024-4f25-b1fa-52424b79b662> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:12:55 user nova-compute[72904]:   <uuid>f8dad8d9-a024-4f25-b1fa-52424b79b662</uuid>
Aug 27 05:12:55 user nova-compute[72904]:   <name>instance-00000017</name>
Aug 27 05:12:55 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:12:55 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:12:55 user nova-compute[72904]:   <metadata>
Aug 27 05:12:55 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:12:55 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:12:55 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-413967328</nova:name>
Aug 27 05:12:55 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:12:54</nova:creationTime>
Aug 27 05:12:55 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:12:55 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:12:55 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:12:55 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:12:55 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:12:55 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:12:55 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:12:55 user nova-compute[72904]:       <nova:owner>
Aug 27 05:12:55 user nova-compute[72904]:         <nova:user uuid="bd521a1e127f496fa4e7865cfedf106f">tempest-AttachVolumeShelveTestJSON-1010055172-project-member</nova:user>
Aug 27 05:12:55 user nova-compute[72904]:         <nova:project uuid="0fc9180eede040eaa688e81896d5c3c4">tempest-AttachVolumeShelveTestJSON-1010055172</nova:project>
Aug 27 05:12:55 user nova-compute[72904]:       </nova:owner>
Aug 27 05:12:55 user nova-compute[72904]:       <nova:root type="image" uuid="7c11121c-dcd3-4da1-9163-f72105fe9ea7"/>
Aug 27 05:12:55 user nova-compute[72904]:       <nova:ports>
Aug 27 05:12:55 user nova-compute[72904]:         <nova:port uuid="3874404d-4f70-43f4-b56b-5d7368b97827">
Aug 27 05:12:55 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 05:12:55 user nova-compute[72904]:         </nova:port>
Aug 27 05:12:55 user nova-compute[72904]:       </nova:ports>
Aug 27 05:12:55 user nova-compute[72904]:     </nova:instance>
Aug 27 05:12:55 user nova-compute[72904]:   </metadata>
Aug 27 05:12:55 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:12:55 user nova-compute[72904]:     <system>
Aug 27 05:12:55 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:12:55 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:12:55 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:12:55 user nova-compute[72904]:       <entry name="serial">f8dad8d9-a024-4f25-b1fa-52424b79b662</entry>
Aug 27 05:12:55 user nova-compute[72904]:       <entry name="uuid">f8dad8d9-a024-4f25-b1fa-52424b79b662</entry>
Aug 27 05:12:55 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:12:55 user nova-compute[72904]:     </system>
Aug 27 05:12:55 user nova-compute[72904]:   </sysinfo>
Aug 27 05:12:55 user nova-compute[72904]:   <os>
Aug 27 05:12:55 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:12:55 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:12:55 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:12:55 user nova-compute[72904]:   </os>
Aug 27 05:12:55 user nova-compute[72904]:   <features>
Aug 27 05:12:55 user nova-compute[72904]:     <acpi/>
Aug 27 05:12:55 user nova-compute[72904]:     <apic/>
Aug 27 05:12:55 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:12:55 user nova-compute[72904]:   </features>
Aug 27 05:12:55 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:12:55 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:12:55 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:12:55 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:12:55 user nova-compute[72904]:   </clock>
Aug 27 05:12:55 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:12:55 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:12:55 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:12:55 user nova-compute[72904]:   </cpu>
Aug 27 05:12:55 user nova-compute[72904]:   <devices>
Aug 27 05:12:55 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:12:55 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:12:55 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk"/>
Aug 27 05:12:55 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:12:55 user nova-compute[72904]:     </disk>
Aug 27 05:12:55 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:12:55 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:12:55 user nova-compute[72904]:       <source dev="/dev/sde"/>
Aug 27 05:12:55 user nova-compute[72904]:       <target dev="vdc" bus="virtio"/>
Aug 27 05:12:55 user nova-compute[72904]:       <serial>8fdc8739-5ca2-400b-9c9b-605dd162c22f</serial>
Aug 27 05:12:55 user nova-compute[72904]:     </disk>
Aug 27 05:12:55 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:12:55 user nova-compute[72904]:       <mac address="fa:16:3e:5b:e0:b5"/>
Aug 27 05:12:55 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:55 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:12:55 user nova-compute[72904]:       <target dev="tap3874404d-4f"/>
Aug 27 05:12:55 user nova-compute[72904]:     </interface>
Aug 27 05:12:55 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:12:55 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/console.log" append="off"/>
Aug 27 05:12:55 user nova-compute[72904]:     </serial>
Aug 27 05:12:55 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:12:55 user nova-compute[72904]:     <video>
Aug 27 05:12:55 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:12:55 user nova-compute[72904]:     </video>
Aug 27 05:12:55 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:12:55 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:12:55 user nova-compute[72904]:     </rng>
Aug 27 05:12:55 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:12:55 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:12:55 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:12:55 user nova-compute[72904]:     </memballoon>
Aug 27 05:12:55 user nova-compute[72904]:   </devices>
Aug 27 05:12:55 user nova-compute[72904]: </domain>
Aug 27 05:12:55 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-413967328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-413967328',id=23,image_ref='7c11121c-dcd3-4da1-9163-f72105fe9ea7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-272173837',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-gy814sik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member',shelved_at='2023-08-27T05:10:45.647294',shelved_host='user',shelved_image_id='7c11121c-dcd3-4da1-9163-f72105fe9ea7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=f8dad8d9-a024-4f25-b1fa-52424b79b662,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG os_vif [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3874404d-4f, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3874404d-4f, col_values=(('external_ids', {'iface-id': '3874404d-4f70-43f4-b56b-5d7368b97827', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:e0:b5', 'vm-uuid': 'f8dad8d9-a024-4f25-b1fa-52424b79b662'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:55 user nova-compute[72904]: INFO os_vif [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f')
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:12:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No VIF found with MAC fa:16:3e:5b:e0:b5, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:12:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-cc0461ec-888d-4bb4-bc36-395aa99171d2 req-6f6463cd-60ba-4d7b-93c1-21f7b42477f3 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cc0461ec-888d-4bb4-bc36-395aa99171d2 req-6f6463cd-60ba-4d7b-93c1-21f7b42477f3 service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cc0461ec-888d-4bb4-bc36-395aa99171d2 req-6f6463cd-60ba-4d7b-93c1-21f7b42477f3 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cc0461ec-888d-4bb4-bc36-395aa99171d2 req-6f6463cd-60ba-4d7b-93c1-21f7b42477f3 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-cc0461ec-888d-4bb4-bc36-395aa99171d2 req-6f6463cd-60ba-4d7b-93c1-21f7b42477f3 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:57 user nova-compute[72904]: WARNING nova.compute.manager [req-cc0461ec-888d-4bb4-bc36-395aa99171d2 req-6f6463cd-60ba-4d7b-93c1-21f7b42477f3 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received unexpected event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113179.4778605, f8dad8d9-a024-4f25-b1fa-52424b79b662 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:59 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] VM Resumed (Lifecycle Event)
Aug 27 05:12:59 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance spawned successfully.
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:59 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113179.481026, f8dad8d9-a024-4f25-b1fa-52424b79b662 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:12:59 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] VM Started (Lifecycle Event)
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:12:59 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-745ef2d5-20e2-4d3b-9f7f-6f5828ddfef3 req-f1908e12-f07e-4dfc-b4ef-bf789aa78e24 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-745ef2d5-20e2-4d3b-9f7f-6f5828ddfef3 req-f1908e12-f07e-4dfc-b4ef-bf789aa78e24 service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-745ef2d5-20e2-4d3b-9f7f-6f5828ddfef3 req-f1908e12-f07e-4dfc-b4ef-bf789aa78e24 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-745ef2d5-20e2-4d3b-9f7f-6f5828ddfef3 req-f1908e12-f07e-4dfc-b4ef-bf789aa78e24 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-745ef2d5-20e2-4d3b-9f7f-6f5828ddfef3 req-f1908e12-f07e-4dfc-b4ef-bf789aa78e24 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:12:59 user nova-compute[72904]: WARNING nova.compute.manager [req-745ef2d5-20e2-4d3b-9f7f-6f5828ddfef3 req-f1908e12-f07e-4dfc-b4ef-bf789aa78e24 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received unexpected event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 05:12:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:12:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e0588044-8701-43db-b667-602afca9375b tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.212s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-changed-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:18 user nova-compute[72904]: DEBUG nova.compute.manager [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Refreshing instance network info cache due to event network-changed-28a8a801-ba7a-46bc-b814-6032fd49ebb6. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:13:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] Acquiring lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:13:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] Acquired lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:13:18 user nova-compute[72904]: DEBUG nova.network.neutron [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Refreshing network info cache for port 28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'flavor' on Instance uuid 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updated VIF entry in instance network info cache for port 28a8a801-ba7a-46bc-b814-6032fd49ebb6. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG nova.network.neutron [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updating instance_info_cache with network_info: [{"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eaf56184-a80e-4922-afff-6b2f570b4fd5 req-cdc05156-dc73-4296-a9b1-aaa2f8b30b35 service nova] Releasing lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:19 user nova-compute[72904]: INFO nova.compute.manager [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Attaching volume 2a3e9c6b-8fdd-410f-b981-8127468b1f1a to /dev/vdb
Aug 27 05:13:19 user nova-compute[72904]: DEBUG os_brick.utils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa10e8b5-062f-4463-a458-8fe08390a8a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa7fb6-ddd4-490b-8a35-c27f75968e34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d41c77c-5803-4413-b207-da73813ac2c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4333a62a-5aa7-4419-ae31-58df9a452258]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:13:19 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:13:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc652fe-2a77-4f40-9afc-f5ae065c56fe]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG os_brick.utils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:13:19 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updating existing volume attachment record: c2680e38-62f2-4e1a-a57d-5271c12e441c {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:13:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:28 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:13:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-changed-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Refreshing instance network info cache due to event network-changed-811a678a-fd9d-44ff-96c5-1a76b0bd0df3. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] Acquiring lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] Acquired lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Refreshing network info cache for port 811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updated VIF entry in instance network info cache for port 811a678a-fd9d-44ff-96c5-1a76b0bd0df3. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updating instance_info_cache with network_info: [{"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4736f5f4-7ce4-46db-b355-593d98901c9b req-3bae17dc-4220-4b44-8950-90828bf64284 service nova] Releasing lock "refresh_cache-8b96c2eb-dd8b-4d42-94de-dab850795ecd" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG nova.objects.instance [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'flavor' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:31 user nova-compute[72904]: INFO nova.compute.manager [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Attaching volume 15f3bc2d-094c-47e8-b92b-ecc4a13c1709 to /dev/vdb
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.utils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9394f5c-de36-4977-9097-afc8334d9c89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e19f6d-dbea-46df-bc4c-333769bb398e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd9561-61cc-4af2-9d4d-487d34748cab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33e3ce4-d3c0-4541-912a-d50c24202520]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:13:31 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d3dc08-0d93-4e91-97fc-5d455cb3c30b]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.utils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updating existing volume attachment record: 387be3f0-0eba-410d-80bd-821370e53dc0 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKAJXIuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:13:31 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:13:31 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:13:31 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8006f63-f65e-4971-850d-b94847cdd4bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:13:31 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[93541b55-c7db-4351-9af8-b544619a0135]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a] added
Aug 27 05:13:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e041aa-c302-4202-a996-18a5c3ba1ecd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[159c5b71-cbce-4513-ae47-4b162ea074b1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKAJXIuO {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKAJXIuO" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d70e3d-75eb-4e26-9a67-0ec00cc95101]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKAJXIuO'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b425654-2117-4a6d-ad57-54dcec7ee385]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8c913f-3687-43e5-b93c-804b6acaf20d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce093df4-4bdd-41c1-b938-1c4c54b7f11d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260]
Aug 27 05:13:32 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260] successful.
Aug 27 05:13:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bbe2ea-2921-4067-8212-57f41d5fe473]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[796eeb60-37c6-4f05-abd4-bde43175f28b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a (non-flash)
Aug 27 05:13:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:32 user nova-compute[72904]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a (non-flash)
Aug 27 05:13:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67d83a9-91bc-452f-a02a-3fe53977c97e]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKAJXIuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.685s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] <== connect_volume: return (1688ms) {'type': 'block', 'scsi_wwn': '23364376664653063', 'path': '/dev/sdf'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364376664653063', 'path': '/dev/sdf'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:13:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:13:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7207MB free_disk=25.318126678466797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'flavor' on Instance uuid 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:13:33 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:13:33 user nova-compute[72904]:   <source dev="/dev/sdf"/>
Aug 27 05:13:33 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:13:33 user nova-compute[72904]:   <serial>2a3e9c6b-8fdd-410f-b981-8127468b1f1a</serial>
Aug 27 05:13:33 user nova-compute[72904]: </disk>
Aug 27 05:13:33 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12852d71-dd0e-46da-8b7b-674551d62f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e8403a20-3d6b-4897-b697-fdb1e7722e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f8dad8d9-a024-4f25-b1fa-52424b79b662 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No VIF found with MAC fa:16:3e:1c:87:d8, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:13:33 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:13:34 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:13:34 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:13:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5220f7cf-480c-4c9a-8bc2-d515e4013b67 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.725s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:13:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:36 user nova-compute[72904]: INFO nova.compute.manager [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Detaching volume 2a3e9c6b-8fdd-410f-b981-8127468b1f1a
Aug 27 05:13:36 user nova-compute[72904]: INFO nova.virt.block_device [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Attempting to driver detach volume 2a3e9c6b-8fdd-410f-b981-8127468b1f1a from mountpoint /dev/vdb
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Attempting to detach device vdb from instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:13:36 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:13:36 user nova-compute[72904]:   <source dev="/dev/sdf"/>
Aug 27 05:13:36 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:13:36 user nova-compute[72904]:   <serial>2a3e9c6b-8fdd-410f-b981-8127468b1f1a</serial>
Aug 27 05:13:36 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:13:36 user nova-compute[72904]: </disk>
Aug 27 05:13:36 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:13:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully detached device vdb from instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a from the persistent domain config.
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:13:36 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:13:36 user nova-compute[72904]:   <source dev="/dev/sdf"/>
Aug 27 05:13:36 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:13:36 user nova-compute[72904]:   <serial>2a3e9c6b-8fdd-410f-b981-8127468b1f1a</serial>
Aug 27 05:13:36 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:13:36 user nova-compute[72904]: </disk>
Aug 27 05:13:36 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113216.675542, 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:13:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully detached device vdb from instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a from the live domain config.
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKAJXIuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:13:36 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42c3b6-1241-4323-afdd-215e614417a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a1d70-8298-4698-a577-1e85baef5750]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a (non-flash)
Aug 27 05:13:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:36 user nova-compute[72904]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a (non-flash)
Aug 27 05:13:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c5d1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a'): ({'sdf'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Removing single pathed devices sdf {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aff84a9-0043-4310-8c40-56396f80ccb9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e864867a-1f38-45f1-a6d0-52b1a9ee63de]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Flushing IO for device /dev/sdf {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f5f75-02a0-4073-ba33-dace916cb51f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b168976b-9c16-4db7-abb0-20cff3e7b254]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de62af-fefb-4deb-a534-63f918cc8381]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[df05306f-55b5-4a93-bd90-012cd8959490]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260]
Aug 27 05:13:36 user nova-compute[72904]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a, portal: 172.16.0.220,3260] successful.
Aug 27 05:13:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3e9c6b-8fdd-410f-b981-8127468b1f1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733e56b-f9bc-4dea-8179-63d69554b024]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] <== disconnect_volume: return (277ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:13:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:13:37 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'flavor' on Instance uuid 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1da065c4-9efc-43e4-9254-cf895ade8e6f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.794s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:13:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:13:44 user nova-compute[72904]: INFO nova.compute.claims [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Claim successful on node user
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:13:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.policy [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '223d760d5f03408781a9241f98a5a6c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b16eb565e64463c9a6e61ddcad25728', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:13:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Creating image(s)
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk 1073741824" returned: 0 in 0.053s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Successfully created port: cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Cannot resize image /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Ensure instance console log exists: /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Successfully updated port: cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing instance network info cache due to event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] Acquiring lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance network_info: |[{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] Acquired lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Start _get_guest_xml network_info=[{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:13:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:13:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-964941530',display_name='tempest-ServerRescueNegativeTestJSON-server-964941530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-964941530',id=28,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCwGsbTWKclBmdJpysTtFepyuf/r32Xo/ACVhO6iycF8/M0FEO8SOaca+JxtvLJeqK29+Mqn/TLgD6cDUZJZuegZiX7Oh/SnEAFe/0bF69k9zC0QmLZ75dZPHWAlh9wvQ==',key_name='tempest-keypair-1522623289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-yqjvoune',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:13:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='223d760d5f03408781a9241f98a5a6c8',uuid=6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:13:47 user nova-compute[72904]:   <uuid>6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049</uuid>
Aug 27 05:13:47 user nova-compute[72904]:   <name>instance-0000001c</name>
Aug 27 05:13:47 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:13:47 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:13:47 user nova-compute[72904]:   <metadata>
Aug 27 05:13:47 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:13:47 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:13:47 user nova-compute[72904]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-964941530</nova:name>
Aug 27 05:13:47 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:13:47</nova:creationTime>
Aug 27 05:13:47 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:13:47 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:13:47 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:13:47 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:13:47 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:13:47 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:13:47 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:13:47 user nova-compute[72904]:       <nova:owner>
Aug 27 05:13:47 user nova-compute[72904]:         <nova:user uuid="223d760d5f03408781a9241f98a5a6c8">tempest-ServerRescueNegativeTestJSON-275121126-project-member</nova:user>
Aug 27 05:13:47 user nova-compute[72904]:         <nova:project uuid="1b16eb565e64463c9a6e61ddcad25728">tempest-ServerRescueNegativeTestJSON-275121126</nova:project>
Aug 27 05:13:47 user nova-compute[72904]:       </nova:owner>
Aug 27 05:13:47 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:13:47 user nova-compute[72904]:       <nova:ports>
Aug 27 05:13:47 user nova-compute[72904]:         <nova:port uuid="cc57cb58-ff4a-41a2-a902-9691bd2c9217">
Aug 27 05:13:47 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 05:13:47 user nova-compute[72904]:         </nova:port>
Aug 27 05:13:47 user nova-compute[72904]:       </nova:ports>
Aug 27 05:13:47 user nova-compute[72904]:     </nova:instance>
Aug 27 05:13:47 user nova-compute[72904]:   </metadata>
Aug 27 05:13:47 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:13:47 user nova-compute[72904]:     <system>
Aug 27 05:13:47 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:13:47 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:13:47 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:13:47 user nova-compute[72904]:       <entry name="serial">6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049</entry>
Aug 27 05:13:47 user nova-compute[72904]:       <entry name="uuid">6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049</entry>
Aug 27 05:13:47 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:13:47 user nova-compute[72904]:     </system>
Aug 27 05:13:47 user nova-compute[72904]:   </sysinfo>
Aug 27 05:13:47 user nova-compute[72904]:   <os>
Aug 27 05:13:47 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:13:47 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:13:47 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:13:47 user nova-compute[72904]:   </os>
Aug 27 05:13:47 user nova-compute[72904]:   <features>
Aug 27 05:13:47 user nova-compute[72904]:     <acpi/>
Aug 27 05:13:47 user nova-compute[72904]:     <apic/>
Aug 27 05:13:47 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:13:47 user nova-compute[72904]:   </features>
Aug 27 05:13:47 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:13:47 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:13:47 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:13:47 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:13:47 user nova-compute[72904]:   </clock>
Aug 27 05:13:47 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:13:47 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:13:47 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:13:47 user nova-compute[72904]:   </cpu>
Aug 27 05:13:47 user nova-compute[72904]:   <devices>
Aug 27 05:13:47 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:13:47 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:13:47 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk"/>
Aug 27 05:13:47 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:13:47 user nova-compute[72904]:     </disk>
Aug 27 05:13:47 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:13:47 user nova-compute[72904]:       <mac address="fa:16:3e:f3:53:c0"/>
Aug 27 05:13:47 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:13:47 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:13:47 user nova-compute[72904]:       <target dev="tapcc57cb58-ff"/>
Aug 27 05:13:47 user nova-compute[72904]:     </interface>
Aug 27 05:13:47 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:13:47 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/console.log" append="off"/>
Aug 27 05:13:47 user nova-compute[72904]:     </serial>
Aug 27 05:13:47 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:13:47 user nova-compute[72904]:     <video>
Aug 27 05:13:47 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:13:47 user nova-compute[72904]:     </video>
Aug 27 05:13:47 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:13:47 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:13:47 user nova-compute[72904]:     </rng>
Aug 27 05:13:47 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:13:47 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:13:47 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:13:47 user nova-compute[72904]:     </memballoon>
Aug 27 05:13:47 user nova-compute[72904]:   </devices>
Aug 27 05:13:47 user nova-compute[72904]: </domain>
Aug 27 05:13:47 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-964941530',display_name='tempest-ServerRescueNegativeTestJSON-server-964941530',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-964941530',id=28,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCwGsbTWKclBmdJpysTtFepyuf/r32Xo/ACVhO6iycF8/M0FEO8SOaca+JxtvLJeqK29+Mqn/TLgD6cDUZJZuegZiX7Oh/SnEAFe/0bF69k9zC0QmLZ75dZPHWAlh9wvQ==',key_name='tempest-keypair-1522623289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-yqjvoune',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:13:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='223d760d5f03408781a9241f98a5a6c8',uuid=6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG os_vif [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc57cb58-ff, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc57cb58-ff, col_values=(('external_ids', {'iface-id': 'cc57cb58-ff4a-41a2-a902-9691bd2c9217', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:53:c0', 'vm-uuid': '6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:47 user nova-compute[72904]: INFO os_vif [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff')
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No VIF found with MAC fa:16:3e:f3:53:c0, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updated VIF entry in instance network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:13:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d017789b-5b0e-4ab9-b935-2b43a4007ef0 req-efe50ea0-d7f5-4394-93ea-9703e810a7e9 service nova] Releasing lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:13:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-25c02ba5-6f53-4387-b4a4-562363e80fe5 req-587398f5-af84-46fa-b107-82537d32d978 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25c02ba5-6f53-4387-b4a4-562363e80fe5 req-587398f5-af84-46fa-b107-82537d32d978 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25c02ba5-6f53-4387-b4a4-562363e80fe5 req-587398f5-af84-46fa-b107-82537d32d978 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25c02ba5-6f53-4387-b4a4-562363e80fe5 req-587398f5-af84-46fa-b107-82537d32d978 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-25c02ba5-6f53-4387-b4a4-562363e80fe5 req-587398f5-af84-46fa-b107-82537d32d978 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:13:49 user nova-compute[72904]: WARNING nova.compute.manager [req-25c02ba5-6f53-4387-b4a4-562363e80fe5 req-587398f5-af84-46fa-b107-82537d32d978 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state building and task_state spawning.
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113231.129611, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:13:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] VM Resumed (Lifecycle Event)
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:13:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance spawned successfully.
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:13:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113231.1308277, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:13:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] VM Started (Lifecycle Event)
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:13:51 user nova-compute[72904]: INFO nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:13:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-657e646f-9a7d-4356-8701-8714d04b0370 req-ab10df1e-86ae-4a09-b335-0296428c9258 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-657e646f-9a7d-4356-8701-8714d04b0370 req-ab10df1e-86ae-4a09-b335-0296428c9258 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-657e646f-9a7d-4356-8701-8714d04b0370 req-ab10df1e-86ae-4a09-b335-0296428c9258 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-657e646f-9a7d-4356-8701-8714d04b0370 req-ab10df1e-86ae-4a09-b335-0296428c9258 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-657e646f-9a7d-4356-8701-8714d04b0370 req-ab10df1e-86ae-4a09-b335-0296428c9258 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:13:51 user nova-compute[72904]: WARNING nova.compute.manager [req-657e646f-9a7d-4356-8701-8714d04b0370 req-ab10df1e-86ae-4a09-b335-0296428c9258 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state building and task_state spawning.
Aug 27 05:13:51 user nova-compute[72904]: INFO nova.compute.manager [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Took 6.49 seconds to build instance.
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3651bef5-67d1-4763-ad6a-41713eefdbf1 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.591s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOEChZeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:13:51 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:13:51 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:13:51 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe3969f-358e-45c7-b984-11881dac9abd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:13:51 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec8f009-478f-4c98-921e-dac38dde7969]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709] added
Aug 27 05:13:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f8059-6a31-4d5a-8b49-b00240507f39]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed04a7b-eae1-477c-a892-53f95f36fa8b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOEChZeJ {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GOEChZeJ" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcac414-49f2-4483-8f5e-e561ddccba08]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GOEChZeJ'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e494391-4d35-43da-a619-6adc441d8419]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2860ba6a-2f69-4a2f-a4dc-f0428afdb167]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:51 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:51 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:51 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:51 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:51 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:51 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbdd643-4f96-440e-a64c-f2b916782e80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260]
Aug 27 05:13:51 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260] successful.
Aug 27 05:13:51 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45b6d04-95bb-43a8-af94-c62fdec663b3]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad49eb21-07ed-466f-99b4-2406078b835f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:13:52 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:13:52 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:13:52 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ddd81e-feb5-4dee-aa2e-1ec58d84a828]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOEChZeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:13:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26263636263366335', 'path': '/dev/sdf'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263636263366335', 'path': '/dev/sdf'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG nova.objects.instance [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'flavor' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:13:53 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:13:53 user nova-compute[72904]:   <source dev="/dev/sdf"/>
Aug 27 05:13:53 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:13:53 user nova-compute[72904]:   <serial>15f3bc2d-094c-47e8-b92b-ecc4a13c1709</serial>
Aug 27 05:13:53 user nova-compute[72904]: </disk>
Aug 27 05:13:53 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No VIF found with MAC fa:16:3e:f2:b9:68, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:13:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-57b68faa-84b2-4bd4-8d3a-38361bcdce09 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.660s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:55 user nova-compute[72904]: INFO nova.compute.manager [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Terminating instance
Aug 27 05:13:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-b429f1fd-a534-419f-b3e3-3e03ebc7af6d req-148a7641-d3c6-4cda-8d5d-5ad8072335ec service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b429f1fd-a534-419f-b3e3-3e03ebc7af6d req-148a7641-d3c6-4cda-8d5d-5ad8072335ec service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b429f1fd-a534-419f-b3e3-3e03ebc7af6d req-148a7641-d3c6-4cda-8d5d-5ad8072335ec service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b429f1fd-a534-419f-b3e3-3e03ebc7af6d req-148a7641-d3c6-4cda-8d5d-5ad8072335ec service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-b429f1fd-a534-419f-b3e3-3e03ebc7af6d req-148a7641-d3c6-4cda-8d5d-5ad8072335ec service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-b429f1fd-a534-419f-b3e3-3e03ebc7af6d req-148a7641-d3c6-4cda-8d5d-5ad8072335ec service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-unplugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:13:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Instance destroyed successfully.
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'resources' on Instance uuid ba4f9f20-2e95-465f-9b3f-4b4712b199ca {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1389826246',display_name='tempest-AttachVolumeTestJSON-server-1389826246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1389826246',id=14,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSI+HPcBRb5onY/njV5ZsRK/5LaHPCHjO7iVu/aRBVdKoIasrL3wJovueufceifil/jhj2KSYn7hNbQk6a47Qt+vpWPm4YKqMRj0O2Lbvhdgw6kPvK8KEEwRyoQ2MhTmw==',key_name='tempest-keypair-1737405625',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-bayhnlo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:12:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=ba4f9f20-2e95-465f-9b3f-4b4712b199ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "address": "fa:16:3e:18:1b:7a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd634d4ec-36", "ovs_interfaceid": "d634d4ec-3655-45de-860f-ba7e1a7e3455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG os_vif [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd634d4ec-36, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:13:56 user nova-compute[72904]: INFO os_vif [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:1b:7a,bridge_name='br-int',has_traffic_filtering=True,id=d634d4ec-3655-45de-860f-ba7e1a7e3455,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd634d4ec-36')
Aug 27 05:13:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Deleting instance files /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca_del
Aug 27 05:13:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Deletion of /opt/stack/data/nova/instances/ba4f9f20-2e95-465f-9b3f-4b4712b199ca_del complete
Aug 27 05:13:56 user nova-compute[72904]: INFO nova.compute.manager [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 05:13:56 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:13:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:13:57 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:13:57 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Took 1.17 seconds to deallocate network for instance.
Aug 27 05:13:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-be3a851c-494f-41cb-8814-a84ca7afbcd8 req-cd3f9e38-5106-4690-866e-505c4d6dd487 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-deleted-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'flavor' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:58 user nova-compute[72904]: INFO nova.compute.manager [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Attaching volume 215c3a6a-7db1-4a72-bbdb-eac51188803e to /dev/vdc
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-c5a6c34b-2a38-488c-9c12-8176c9ea1828 req-4c73e794-323c-435c-a10d-080a636a1d69 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c5a6c34b-2a38-488c-9c12-8176c9ea1828 req-4c73e794-323c-435c-a10d-080a636a1d69 service nova] Acquiring lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c5a6c34b-2a38-488c-9c12-8176c9ea1828 req-4c73e794-323c-435c-a10d-080a636a1d69 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c5a6c34b-2a38-488c-9c12-8176c9ea1828 req-4c73e794-323c-435c-a10d-080a636a1d69 service nova] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-c5a6c34b-2a38-488c-9c12-8176c9ea1828 req-4c73e794-323c-435c-a10d-080a636a1d69 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] No waiting events found dispatching network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:13:58 user nova-compute[72904]: WARNING nova.compute.manager [req-c5a6c34b-2a38-488c-9c12-8176c9ea1828 req-4c73e794-323c-435c-a10d-080a636a1d69 service nova] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Received unexpected event network-vif-plugged-d634d4ec-3655-45de-860f-ba7e1a7e3455 for instance with vm_state deleted and task_state None.
Aug 27 05:13:58 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Deleted allocations for instance ba4f9f20-2e95-465f-9b3f-4b4712b199ca
Aug 27 05:13:58 user nova-compute[72904]: DEBUG os_brick.utils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf801ab-6c56-4a86-b6ef-01de870df3e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecadfd0-fe3b-406f-8333-dd0f5f92068c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[30614050-323b-4b6e-8d2c-4d83503ed35b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a8ac2-c980-4e70-ac80-af59fc9583d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d6671ef1-a6ce-41c9-8fd8-4484d2a140e3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "ba4f9f20-2e95-465f-9b3f-4b4712b199ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.724s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:13:58 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:13:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb1c6f8-5776-4622-8803-de2813935eb6]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG os_brick.utils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:13:58 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updating existing volume attachment record: c91d72df-d377-4cc9-a114-973a76473764 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:14:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:14:08 user nova-compute[72904]: INFO nova.compute.claims [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Claim successful on node user
Aug 27 05:14:08 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:14:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:14:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Creating image(s)
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "/opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.policy [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4bbded3a71e4d6196d83c1fa5e7a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ae29302d54f8aa82e6c51bbfba65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk 1073741824" returned: 0 in 0.060s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Successfully created port: 7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Cannot resize image /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Ensure instance console log exists: /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJPsMHOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:14:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:14:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:14:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:14:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:14:10 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:14:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90071c-6f61-4c1a-aa42-9d99d1ac59f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:14:10 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38c7f58-002c-48d0-9210-ecceb6cb41a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e] added
Aug 27 05:14:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[870225c4-85ca-46c4-b3a4-720a0c1dfd7d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae6475-ea81-4a44-95dc-760df9aa9d18]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJPsMHOc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJPsMHOc" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9d9650-ad13-40b8-b4e6-9cab9167e072]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJPsMHOc'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf19ed1-2761-4458-b63b-6f0d870c3312]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Successfully updated port: 7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced5124e-85dc-4323-b51e-39ca2e9aeb2f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received event network-changed-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Refreshing instance network info cache due to event network-changed-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] Acquiring lock "refresh_cache-10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2809be86-99ae-4289-b384-6b4a30845464]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260]
Aug 27 05:14:11 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260] successful.
Aug 27 05:14:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113236.2341194, ba4f9f20-2e95-465f-9b3f-4b4712b199ca => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:14:11 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] VM Stopped (Lifecycle Event)
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e487f0b7-802b-4caf-97f3-61d131f08c12]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-aaf0ea6f-3cef-4079-ba12-a893079faac7 None None] [instance: ba4f9f20-2e95-465f-9b3f-4b4712b199ca] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[61786f03-0a1a-4cfc-ad13-1c017820efdd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e (non-flash)
Aug 27 05:14:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:11 user nova-compute[72904]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e (non-flash)
Aug 27 05:14:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a31e39-9866-41a2-a452-4a9d9bd61dac]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJPsMHOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Updating instance_info_cache with network_info: [{"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Instance network_info: |[{"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] Acquired lock "refresh_cache-10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Refreshing network info cache for port 7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Start _get_guest_xml network_info=[{"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:14:11 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:11 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-618888764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-618888764',id=29,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-w4d6dikg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:14:09Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=10c3d7d3-4b6e-4ca1-9b22-d84f865867cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:07,bridge_name='br-int',has_traffic_filtering=True,id=7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0a785-db') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.objects.instance [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'pci_devices' on Instance uuid 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:14:11 user nova-compute[72904]:   <uuid>10c3d7d3-4b6e-4ca1-9b22-d84f865867cb</uuid>
Aug 27 05:14:11 user nova-compute[72904]:   <name>instance-0000001d</name>
Aug 27 05:14:11 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:14:11 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:14:11 user nova-compute[72904]:   <metadata>
Aug 27 05:14:11 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:14:11 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:14:11 user nova-compute[72904]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-618888764</nova:name>
Aug 27 05:14:11 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:14:11</nova:creationTime>
Aug 27 05:14:11 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:14:11 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:14:11 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:14:11 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:14:11 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:14:11 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:14:11 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:14:11 user nova-compute[72904]:       <nova:owner>
Aug 27 05:14:11 user nova-compute[72904]:         <nova:user uuid="f4bbded3a71e4d6196d83c1fa5e7a868">tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member</nova:user>
Aug 27 05:14:11 user nova-compute[72904]:         <nova:project uuid="da9ae29302d54f8aa82e6c51bbfba65d">tempest-ServerBootFromVolumeStableRescueTest-1493340065</nova:project>
Aug 27 05:14:11 user nova-compute[72904]:       </nova:owner>
Aug 27 05:14:11 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:14:11 user nova-compute[72904]:       <nova:ports>
Aug 27 05:14:11 user nova-compute[72904]:         <nova:port uuid="7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec">
Aug 27 05:14:11 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 05:14:11 user nova-compute[72904]:         </nova:port>
Aug 27 05:14:11 user nova-compute[72904]:       </nova:ports>
Aug 27 05:14:11 user nova-compute[72904]:     </nova:instance>
Aug 27 05:14:11 user nova-compute[72904]:   </metadata>
Aug 27 05:14:11 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:14:11 user nova-compute[72904]:     <system>
Aug 27 05:14:11 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:14:11 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:14:11 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:14:11 user nova-compute[72904]:       <entry name="serial">10c3d7d3-4b6e-4ca1-9b22-d84f865867cb</entry>
Aug 27 05:14:11 user nova-compute[72904]:       <entry name="uuid">10c3d7d3-4b6e-4ca1-9b22-d84f865867cb</entry>
Aug 27 05:14:11 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:14:11 user nova-compute[72904]:     </system>
Aug 27 05:14:11 user nova-compute[72904]:   </sysinfo>
Aug 27 05:14:11 user nova-compute[72904]:   <os>
Aug 27 05:14:11 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:14:11 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:14:11 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:14:11 user nova-compute[72904]:   </os>
Aug 27 05:14:11 user nova-compute[72904]:   <features>
Aug 27 05:14:11 user nova-compute[72904]:     <acpi/>
Aug 27 05:14:11 user nova-compute[72904]:     <apic/>
Aug 27 05:14:11 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:14:11 user nova-compute[72904]:   </features>
Aug 27 05:14:11 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:14:11 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:14:11 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:14:11 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:14:11 user nova-compute[72904]:   </clock>
Aug 27 05:14:11 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:14:11 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:14:11 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:14:11 user nova-compute[72904]:   </cpu>
Aug 27 05:14:11 user nova-compute[72904]:   <devices>
Aug 27 05:14:11 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:14:11 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:14:11 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk"/>
Aug 27 05:14:11 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:14:11 user nova-compute[72904]:     </disk>
Aug 27 05:14:11 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:14:11 user nova-compute[72904]:       <mac address="fa:16:3e:11:12:07"/>
Aug 27 05:14:11 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:14:11 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:14:11 user nova-compute[72904]:       <target dev="tap7ed0a785-db"/>
Aug 27 05:14:11 user nova-compute[72904]:     </interface>
Aug 27 05:14:11 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:14:11 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/console.log" append="off"/>
Aug 27 05:14:11 user nova-compute[72904]:     </serial>
Aug 27 05:14:11 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:14:11 user nova-compute[72904]:     <video>
Aug 27 05:14:11 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:14:11 user nova-compute[72904]:     </video>
Aug 27 05:14:11 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:14:11 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:14:11 user nova-compute[72904]:     </rng>
Aug 27 05:14:11 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:14:11 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:14:11 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:14:11 user nova-compute[72904]:     </memballoon>
Aug 27 05:14:11 user nova-compute[72904]:   </devices>
Aug 27 05:14:11 user nova-compute[72904]: </domain>
Aug 27 05:14:11 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-618888764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-618888764',id=29,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-w4d6dikg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:14:09Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=10c3d7d3-4b6e-4ca1-9b22-d84f865867cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:07,bridge_name='br-int',has_traffic_filtering=True,id=7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0a785-db') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG os_vif [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:07,bridge_name='br-int',has_traffic_filtering=True,id=7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0a785-db') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ed0a785-db, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ed0a785-db, col_values=(('external_ids', {'iface-id': '7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:12:07', 'vm-uuid': '10c3d7d3-4b6e-4ca1-9b22-d84f865867cb'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:11 user nova-compute[72904]: INFO os_vif [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:07,bridge_name='br-int',has_traffic_filtering=True,id=7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0a785-db')
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No VIF found with MAC fa:16:3e:11:12:07, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Updated VIF entry in instance network info cache for port 7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Updating instance_info_cache with network_info: [{"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2b33bbe8-4acb-429f-bf21-bf16a9e9e913 req-6c926614-c8b0-4cac-86f0-f65de65caa7d service nova] Releasing lock "refresh_cache-10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23532306466383532', 'path': '/dev/sdg'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532306466383532', 'path': '/dev/sdg'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'flavor' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:14:12 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:14:12 user nova-compute[72904]:   <source dev="/dev/sdg"/>
Aug 27 05:14:12 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:14:12 user nova-compute[72904]:   <serial>215c3a6a-7db1-4a72-bbdb-eac51188803e</serial>
Aug 27 05:14:12 user nova-compute[72904]: </disk>
Aug 27 05:14:12 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:14:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] No VIF found with MAC fa:16:3e:f2:b9:68, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ef4b6a16-6d16-46bb-b7bd-b3c7ddfa9554 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.904s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-8f74e695-f4a0-4775-8d8f-e1c7e66486b9 req-8172e794-11c9-440d-bbff-161f4cdf0655 service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received event network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f74e695-f4a0-4775-8d8f-e1c7e66486b9 req-8172e794-11c9-440d-bbff-161f4cdf0655 service nova] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f74e695-f4a0-4775-8d8f-e1c7e66486b9 req-8172e794-11c9-440d-bbff-161f4cdf0655 service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f74e695-f4a0-4775-8d8f-e1c7e66486b9 req-8172e794-11c9-440d-bbff-161f4cdf0655 service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-8f74e695-f4a0-4775-8d8f-e1c7e66486b9 req-8172e794-11c9-440d-bbff-161f4cdf0655 service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] No waiting events found dispatching network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:14:13 user nova-compute[72904]: WARNING nova.compute.manager [req-8f74e695-f4a0-4775-8d8f-e1c7e66486b9 req-8172e794-11c9-440d-bbff-161f4cdf0655 service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received unexpected event network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec for instance with vm_state building and task_state spawning.
Aug 27 05:14:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:14 user nova-compute[72904]: INFO nova.compute.manager [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Detaching volume 215c3a6a-7db1-4a72-bbdb-eac51188803e
Aug 27 05:14:14 user nova-compute[72904]: INFO nova.virt.block_device [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Attempting to driver detach volume 215c3a6a-7db1-4a72-bbdb-eac51188803e from mountpoint /dev/vdc
Aug 27 05:14:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Attempting to detach device vdc from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:14:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:14:14 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:14:14 user nova-compute[72904]:   <source dev="/dev/sdg"/>
Aug 27 05:14:14 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:14:14 user nova-compute[72904]:   <serial>215c3a6a-7db1-4a72-bbdb-eac51188803e</serial>
Aug 27 05:14:14 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 05:14:14 user nova-compute[72904]: </disk>
Aug 27 05:14:14 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:14:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Successfully detached device vdc from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the persistent domain config.
Aug 27 05:14:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:14:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:14:14 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:14:14 user nova-compute[72904]:   <source dev="/dev/sdg"/>
Aug 27 05:14:14 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:14:14 user nova-compute[72904]:   <serial>215c3a6a-7db1-4a72-bbdb-eac51188803e</serial>
Aug 27 05:14:14 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 05:14:14 user nova-compute[72904]: </disk>
Aug 27 05:14:14 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113255.0930376, 8b96c2eb-dd8b-4d42-94de-dab850795ecd => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Successfully detached device vdc from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the live domain config.
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJPsMHOc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:14:15 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27937a8-8d6f-4bd0-8fae-29578427a477]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b10b12-4e4d-4173-94a6-0d8e21d248c6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e (non-flash)
Aug 27 05:14:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:15 user nova-compute[72904]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e (non-flash)
Aug 27 05:14:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91943f6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e'): ({'sdg'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Removing single pathed devices sdg {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[38424f86-3426-4dbe-b0c9-a76b70d37715]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad3c1d0-f3b9-4fd6-bed8-31eaa320ef2b]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Flushing IO for device /dev/sdg {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d001c16d-7587-4cdd-a2bd-4d30dfb6d962]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1459e51e-1036-4d1c-888f-d17279562eea]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] SCSI volumes sdg have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2e6cdb-e8f5-4ed9-b731-a0386c49f08b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba3fc79-8cfe-44d7-8ee0-0c472de2cea1]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260]
Aug 27 05:14:15 user nova-compute[72904]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e, portal: 172.16.0.220,3260] successful.
Aug 27 05:14:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113255.4067087, 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] VM Resumed (Lifecycle Event)
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c3a6a-7db1-4a72-bbdb-eac51188803e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e5173b-cb74-4095-af1f-b0e2abfddd43]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] <== disconnect_volume: return (308ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Instance spawned successfully.
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113255.4102948, 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] VM Started (Lifecycle Event)
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Took 6.35 seconds to spawn the instance on the hypervisor.
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-3350930f-aecb-494f-86ba-3b823d7bbc97 req-112f7f24-99a1-4ee8-958f-9e2ce12577cd service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received event network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3350930f-aecb-494f-86ba-3b823d7bbc97 req-112f7f24-99a1-4ee8-958f-9e2ce12577cd service nova] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3350930f-aecb-494f-86ba-3b823d7bbc97 req-112f7f24-99a1-4ee8-958f-9e2ce12577cd service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3350930f-aecb-494f-86ba-3b823d7bbc97 req-112f7f24-99a1-4ee8-958f-9e2ce12577cd service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-3350930f-aecb-494f-86ba-3b823d7bbc97 req-112f7f24-99a1-4ee8-958f-9e2ce12577cd service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] No waiting events found dispatching network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:14:15 user nova-compute[72904]: WARNING nova.compute.manager [req-3350930f-aecb-494f-86ba-3b823d7bbc97 req-112f7f24-99a1-4ee8-958f-9e2ce12577cd service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received unexpected event network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec for instance with vm_state building and task_state spawning.
Aug 27 05:14:15 user nova-compute[72904]: INFO nova.compute.manager [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Took 7.12 seconds to build instance.
Aug 27 05:14:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7f4808f1-461c-4679-992f-0aa64899c88e tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.228s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:16 user nova-compute[72904]: DEBUG nova.objects.instance [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'flavor' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:14:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-50f946c5-ba05-4ca6-abca-b4e36b164668 tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.767s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:24 user nova-compute[72904]: INFO nova.compute.manager [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Detaching volume 8fdc8739-5ca2-400b-9c9b-605dd162c22f
Aug 27 05:14:24 user nova-compute[72904]: INFO nova.virt.block_device [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Attempting to driver detach volume 8fdc8739-5ca2-400b-9c9b-605dd162c22f from mountpoint /dev/vdc
Aug 27 05:14:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Attempting to detach device vdc from instance f8dad8d9-a024-4f25-b1fa-52424b79b662 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:14:24 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:14:24 user nova-compute[72904]:   <source dev="/dev/sde"/>
Aug 27 05:14:24 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:14:24 user nova-compute[72904]:   <serial>8fdc8739-5ca2-400b-9c9b-605dd162c22f</serial>
Aug 27 05:14:24 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:14:24 user nova-compute[72904]: </disk>
Aug 27 05:14:24 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:14:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully detached device vdc from instance f8dad8d9-a024-4f25-b1fa-52424b79b662 from the persistent domain config.
Aug 27 05:14:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f8dad8d9-a024-4f25-b1fa-52424b79b662 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:14:24 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:14:24 user nova-compute[72904]:   <source dev="/dev/sde"/>
Aug 27 05:14:24 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:14:24 user nova-compute[72904]:   <serial>8fdc8739-5ca2-400b-9c9b-605dd162c22f</serial>
Aug 27 05:14:24 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:14:24 user nova-compute[72904]: </disk>
Aug 27 05:14:24 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113264.8705854, f8dad8d9-a024-4f25-b1fa-52424b79b662 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:14:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully detached device vdc from instance f8dad8d9-a024-4f25-b1fa-52424b79b662 from the live domain config.
Aug 27 05:14:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'neaJclXf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:14:24 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c648e-8654-40d7-bc3b-83315a44452a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d16f55-965b-4b78-881b-bb1f1398c768]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f (non-flash)
Aug 27 05:14:24 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91940eef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f'): ({'sde'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Removing single pathed devices sde {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf74d132-daef-40ce-97b6-84ed12f7fee6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fcd546-20f4-4d00-9b9f-510ed1a08d9b]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flushing IO for device /dev/sde {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:14:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ce1976-38b4-4d25-b66d-cbfd3a7dfde8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e15c4de-a59e-4a9d-8c10-801df6861a44]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab8e3e0-4aa5-43f7-aeeb-297b53e2cd09]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e46463-a694-4066-a0b8-da096e2bfdc8]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260]
Aug 27 05:14:25 user nova-compute[72904]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f, portal: 172.16.0.220,3260] successful.
Aug 27 05:14:25 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fdc8739-5ca2-400b-9c9b-605dd162c22f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af9e4f-29da-4520-a5aa-40971c0a28c0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] <== disconnect_volume: return (285ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:14:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:14:26 user nova-compute[72904]: DEBUG nova.objects.instance [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'flavor' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:14:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-909788a0-bac8-46c1-82b0-6199adbbd296 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing instance network info cache due to event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:14:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] Acquiring lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] Acquired lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:28 user nova-compute[72904]: DEBUG nova.network.neutron [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updated VIF entry in instance network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97a99ca7-9b4a-4c12-8698-d9b9b8cef554 req-7276ad26-0209-4ab0-b704-59900f7f49cf service nova] Releasing lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing instance network info cache due to event network-changed-9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] Acquiring lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] Acquired lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Refreshing network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:30 user nova-compute[72904]: INFO nova.compute.manager [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Detaching volume 298c326d-516b-4651-b281-e38ee7f73250
Aug 27 05:14:30 user nova-compute[72904]: INFO nova.virt.block_device [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Attempting to driver detach volume 298c326d-516b-4651-b281-e38ee7f73250 from mountpoint /dev/vdb
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Attempting to detach device vdb from instance 12852d71-dd0e-46da-8b7b-674551d62f3c from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:14:30 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:14:30 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:14:30 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:14:30 user nova-compute[72904]:   <serial>298c326d-516b-4651-b281-e38ee7f73250</serial>
Aug 27 05:14:30 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:14:30 user nova-compute[72904]: </disk>
Aug 27 05:14:30 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully detached device vdb from instance 12852d71-dd0e-46da-8b7b-674551d62f3c from the persistent domain config.
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 12852d71-dd0e-46da-8b7b-674551d62f3c from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:14:30 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:14:30 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:14:30 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:14:30 user nova-compute[72904]:   <serial>298c326d-516b-4651-b281-e38ee7f73250</serial>
Aug 27 05:14:30 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:14:30 user nova-compute[72904]: </disk>
Aug 27 05:14:30 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updated VIF entry in instance network info cache for port 9a8c4683-4885-4a6e-8832-bf0bb7d96111. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [{"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a053fbcd-3489-42ad-88e5-343d6ec7733e req-43406435-5d78-4a00-894a-0315025f7f5e service nova] Releasing lock "refresh_cache-12852d71-dd0e-46da-8b7b-674551d62f3c" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113270.5945294, 12852d71-dd0e-46da-8b7b-674551d62f3c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:14:30 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully detached device vdb from instance 12852d71-dd0e-46da-8b7b-674551d62f3c from the live domain config.
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRctPSly', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:14:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fb2274-03c2-4871-a25e-1f4c6c559139]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540bb01-bcb5-48c5-ba59-b6a165cbe97e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:30 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:30 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:30 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:14:30 user nova-compute[72904]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 (non-flash)
Aug 27 05:14:30 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:14:30 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:14:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91941d4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[316aeecc-3ec3-4f4b-a2f8-14bd30463723]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec35e39-2e19-4ec0-b9a2-24ae6845b24e]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b96d4-2df0-413f-9d09-05a428f8417a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec70154-4c75-49ac-ad2e-89a59b78f742]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74df0ca2-61dd-4879-af15-e1c23ba0c685]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0050221f-700a-46d7-858e-6eadffc831c7]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260]
Aug 27 05:14:30 user nova-compute[72904]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250, portal: 172.16.0.220,3260] successful.
Aug 27 05:14:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:298c326d-516b-4651-b281-e38ee7f73250 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[118da70f-c323-455c-a928-30d3b0fa94da]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== disconnect_volume: return (321ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:14:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'flavor' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c3a5bf23-232a-4d7d-b2c3-22c1e31e8a85 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.860s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:14:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:34 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:34 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:34 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7152MB free_disk=25.287464141845703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:14:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12852d71-dd0e-46da-8b7b-674551d62f3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e8403a20-3d6b-4897-b697-fdb1e7722e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f8dad8d9-a024-4f25-b1fa-52424b79b662 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.836s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:14:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:14:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:37 user nova-compute[72904]: INFO nova.compute.manager [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] instance snapshotting
Aug 27 05:14:37 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Beginning live snapshot process
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy97ifba/4d870e2649ee4d3e94cdb0ebe1e007e8.delta 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwy97ifba/4d870e2649ee4d3e94cdb0ebe1e007e8.delta 1073741824" returned: 0 in 0.049s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:38 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 05:14:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:14:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:14:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 05:14:39 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:14:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy97ifba/4d870e2649ee4d3e94cdb0ebe1e007e8.delta /opt/stack/data/nova/instances/snapshots/tmpwy97ifba/4d870e2649ee4d3e94cdb0ebe1e007e8 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:14:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwy97ifba/4d870e2649ee4d3e94cdb0ebe1e007e8.delta /opt/stack/data/nova/instances/snapshots/tmpwy97ifba/4d870e2649ee4d3e94cdb0ebe1e007e8" returned: 0 in 0.769s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:40 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Snapshot extracted, beginning image upload
Aug 27 05:14:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 4fba85dc-5514-4bc1-a731-1cd1af6da152 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: INFO nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] During sync_power_state the instance has a pending task (image_uploading). Skip.
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Snapshot image upload complete
Aug 27 05:14:42 user nova-compute[72904]: INFO nova.compute.manager [None req-c92fdf3e-ce8b-4406-9037-44cd5d4c7614 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Took 5.04 seconds to snapshot the instance on the hypervisor.
Aug 27 05:14:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:14:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:14:44 user nova-compute[72904]: INFO nova.compute.claims [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Claim successful on node user
Aug 27 05:14:44 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:14:44 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:14:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:14:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG nova.policy [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21601eb4d7bd479aaaa27ed3040f4dd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '773d80813c21429b836763fdeefb32fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:14:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Creating image(s)
Aug 27 05:14:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "/opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "/opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "/opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "f87b080bbb3122c4c679a27f0a9cf4b7b21b77db" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "f87b080bbb3122c4c679a27f0a9cf4b7b21b77db" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Successfully created port: 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.part --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG nova.virt.images [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] 39fe84d4-3a3d-433f-aa70-45b15e68ffba was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.part /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.part /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.converted" returned: 0 in 0.460s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "f87b080bbb3122c4c679a27f0a9cf4b7b21b77db" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.877s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Successfully updated port: 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquired lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-changed-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Refreshing instance network info cache due to event network-changed-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] Acquiring lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "f87b080bbb3122c4c679a27f0a9cf4b7b21b77db" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "f87b080bbb3122c4c679a27f0a9cf4b7b21b77db" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db,backing_fmt=raw /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updating instance_info_cache with network_info: [{"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Releasing lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Instance network_info: |[{"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db,backing_fmt=raw /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk 1073741824" returned: 0 in 0.359s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] Acquired lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Refreshing network info cache for port 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "f87b080bbb3122c4c679a27f0a9cf4b7b21b77db" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.544s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Ensure instance console log exists: /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Start _get_guest_xml network_info=[{"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='7d33147ed909d1869d97a501d4c7e8eb',container_format='bare',created_at=2023-08-27T05:14:37Z,direct_url=<?>,disk_format='qcow2',id=39fe84d4-3a3d-433f-aa70-45b15e68ffba,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1530316276',owner='773d80813c21429b836763fdeefb32fd',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T05:14:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '39fe84d4-3a3d-433f-aa70-45b15e68ffba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:14:48 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:48 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='7d33147ed909d1869d97a501d4c7e8eb',container_format='bare',created_at=2023-08-27T05:14:37Z,direct_url=<?>,disk_format='qcow2',id=39fe84d4-3a3d-433f-aa70-45b15e68ffba,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1530316276',owner='773d80813c21429b836763fdeefb32fd',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T05:14:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1961842781',display_name='tempest-TestStampPattern-server-1961842781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1961842781',id=30,image_ref='39fe84d4-3a3d-433f-aa70-45b15e68ffba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkwT0EoE+efmSUPXfVnAKwZs3gchQqxEsGoSc6Z2oMKPhVS2FXSU8GCbc7XVowgKS4arjEQy/QXsY6Tc1MDzDaqgmC2lO07jOsRf3bFi2v/ztZO6o9+6NmJW5aEdh8ebg==',key_name='tempest-TestStampPattern-1730672637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='773d80813c21429b836763fdeefb32fd',ramdisk_id='',reservation_id='r-7rcfb1nn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6c4f94ac-01ca-4028-a5d6-f3535edaaa7a',image_min_disk='1',image_min_ram='0',image_owner_id='773d80813c21429b836763fdeefb32fd',image_owner_project_name='tempest-TestStampPattern-885956166',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885956166-project-member',image_user_id='21601eb4d7bd479aaaa27ed3040f4dd1',network_allocated='True',owner_project_name='tempest-TestStampPattern-885956166',owner_user_name='tempest-TestStampPattern-885956166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:14:45Z,user_data=None,user_id='21601eb4d7bd479aaaa27ed3040f4dd1',uuid=be32e4e5-ed6d-4569-88a2-8fb43041e51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converting VIF {"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:38,bridge_name='br-int',has_traffic_filtering=True,id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap701f5cbe-37') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.objects.instance [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'pci_devices' on Instance uuid be32e4e5-ed6d-4569-88a2-8fb43041e51e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:14:48 user nova-compute[72904]:   <uuid>be32e4e5-ed6d-4569-88a2-8fb43041e51e</uuid>
Aug 27 05:14:48 user nova-compute[72904]:   <name>instance-0000001e</name>
Aug 27 05:14:48 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:14:48 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:14:48 user nova-compute[72904]:   <metadata>
Aug 27 05:14:48 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:14:48 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:14:48 user nova-compute[72904]:       <nova:name>tempest-TestStampPattern-server-1961842781</nova:name>
Aug 27 05:14:48 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:14:48</nova:creationTime>
Aug 27 05:14:48 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:14:48 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:14:48 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:14:48 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:14:48 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:14:48 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:14:48 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:14:48 user nova-compute[72904]:       <nova:owner>
Aug 27 05:14:48 user nova-compute[72904]:         <nova:user uuid="21601eb4d7bd479aaaa27ed3040f4dd1">tempest-TestStampPattern-885956166-project-member</nova:user>
Aug 27 05:14:48 user nova-compute[72904]:         <nova:project uuid="773d80813c21429b836763fdeefb32fd">tempest-TestStampPattern-885956166</nova:project>
Aug 27 05:14:48 user nova-compute[72904]:       </nova:owner>
Aug 27 05:14:48 user nova-compute[72904]:       <nova:root type="image" uuid="39fe84d4-3a3d-433f-aa70-45b15e68ffba"/>
Aug 27 05:14:48 user nova-compute[72904]:       <nova:ports>
Aug 27 05:14:48 user nova-compute[72904]:         <nova:port uuid="701f5cbe-3712-479a-a9cb-fed1fa3cd6d7">
Aug 27 05:14:48 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 05:14:48 user nova-compute[72904]:         </nova:port>
Aug 27 05:14:48 user nova-compute[72904]:       </nova:ports>
Aug 27 05:14:48 user nova-compute[72904]:     </nova:instance>
Aug 27 05:14:48 user nova-compute[72904]:   </metadata>
Aug 27 05:14:48 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:14:48 user nova-compute[72904]:     <system>
Aug 27 05:14:48 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:14:48 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:14:48 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:14:48 user nova-compute[72904]:       <entry name="serial">be32e4e5-ed6d-4569-88a2-8fb43041e51e</entry>
Aug 27 05:14:48 user nova-compute[72904]:       <entry name="uuid">be32e4e5-ed6d-4569-88a2-8fb43041e51e</entry>
Aug 27 05:14:48 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:14:48 user nova-compute[72904]:     </system>
Aug 27 05:14:48 user nova-compute[72904]:   </sysinfo>
Aug 27 05:14:48 user nova-compute[72904]:   <os>
Aug 27 05:14:48 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:14:48 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:14:48 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:14:48 user nova-compute[72904]:   </os>
Aug 27 05:14:48 user nova-compute[72904]:   <features>
Aug 27 05:14:48 user nova-compute[72904]:     <acpi/>
Aug 27 05:14:48 user nova-compute[72904]:     <apic/>
Aug 27 05:14:48 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:14:48 user nova-compute[72904]:   </features>
Aug 27 05:14:48 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:14:48 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:14:48 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:14:48 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:14:48 user nova-compute[72904]:   </clock>
Aug 27 05:14:48 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:14:48 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:14:48 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:14:48 user nova-compute[72904]:   </cpu>
Aug 27 05:14:48 user nova-compute[72904]:   <devices>
Aug 27 05:14:48 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:14:48 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:14:48 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk"/>
Aug 27 05:14:48 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:14:48 user nova-compute[72904]:     </disk>
Aug 27 05:14:48 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:14:48 user nova-compute[72904]:       <mac address="fa:16:3e:77:1f:38"/>
Aug 27 05:14:48 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:14:48 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:14:48 user nova-compute[72904]:       <target dev="tap701f5cbe-37"/>
Aug 27 05:14:48 user nova-compute[72904]:     </interface>
Aug 27 05:14:48 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:14:48 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/console.log" append="off"/>
Aug 27 05:14:48 user nova-compute[72904]:     </serial>
Aug 27 05:14:48 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:14:48 user nova-compute[72904]:     <video>
Aug 27 05:14:48 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:14:48 user nova-compute[72904]:     </video>
Aug 27 05:14:48 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:14:48 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:14:48 user nova-compute[72904]:     </rng>
Aug 27 05:14:48 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:14:48 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:14:48 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:14:48 user nova-compute[72904]:     </memballoon>
Aug 27 05:14:48 user nova-compute[72904]:   </devices>
Aug 27 05:14:48 user nova-compute[72904]: </domain>
Aug 27 05:14:48 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1961842781',display_name='tempest-TestStampPattern-server-1961842781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1961842781',id=30,image_ref='39fe84d4-3a3d-433f-aa70-45b15e68ffba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkwT0EoE+efmSUPXfVnAKwZs3gchQqxEsGoSc6Z2oMKPhVS2FXSU8GCbc7XVowgKS4arjEQy/QXsY6Tc1MDzDaqgmC2lO07jOsRf3bFi2v/ztZO6o9+6NmJW5aEdh8ebg==',key_name='tempest-TestStampPattern-1730672637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='773d80813c21429b836763fdeefb32fd',ramdisk_id='',reservation_id='r-7rcfb1nn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6c4f94ac-01ca-4028-a5d6-f3535edaaa7a',image_min_disk='1',image_min_ram='0',image_owner_id='773d80813c21429b836763fdeefb32fd',image_owner_project_name='tempest-TestStampPattern-885956166',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885956166-project-member',image_user_id='21601eb4d7bd479aaaa27ed3040f4dd1',network_allocated='True',owner_project_name='tempest-TestStampPattern-885956166',owner_user_name='tempest-TestStampPattern-885956166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:14:45Z,user_data=None,user_id='21601eb4d7bd479aaaa27ed3040f4dd1',uuid=be32e4e5-ed6d-4569-88a2-8fb43041e51e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converting VIF {"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:38,bridge_name='br-int',has_traffic_filtering=True,id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap701f5cbe-37') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG os_vif [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:38,bridge_name='br-int',has_traffic_filtering=True,id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap701f5cbe-37') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap701f5cbe-37, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap701f5cbe-37, col_values=(('external_ids', {'iface-id': '701f5cbe-3712-479a-a9cb-fed1fa3cd6d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:1f:38', 'vm-uuid': 'be32e4e5-ed6d-4569-88a2-8fb43041e51e'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:48 user nova-compute[72904]: INFO os_vif [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:1f:38,bridge_name='br-int',has_traffic_filtering=True,id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap701f5cbe-37')
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No VIF found with MAC fa:16:3e:77:1f:38, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updated VIF entry in instance network info cache for port 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updating instance_info_cache with network_info: [{"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6d58e0cc-dcd1-4d42-bc1f-8c82f1cc2bb4 req-e00ef1cc-a884-4c04-acfc-d72ded6e1848 service nova] Releasing lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-0dfda410-2d82-4167-af66-8b60c9475bc4 req-a327af24-78c2-45f0-a86c-ec6b430e4890 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0dfda410-2d82-4167-af66-8b60c9475bc4 req-a327af24-78c2-45f0-a86c-ec6b430e4890 service nova] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0dfda410-2d82-4167-af66-8b60c9475bc4 req-a327af24-78c2-45f0-a86c-ec6b430e4890 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0dfda410-2d82-4167-af66-8b60c9475bc4 req-a327af24-78c2-45f0-a86c-ec6b430e4890 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-0dfda410-2d82-4167-af66-8b60c9475bc4 req-a327af24-78c2-45f0-a86c-ec6b430e4890 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] No waiting events found dispatching network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:14:49 user nova-compute[72904]: WARNING nova.compute.manager [req-0dfda410-2d82-4167-af66-8b60c9475bc4 req-a327af24-78c2-45f0-a86c-ec6b430e4890 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received unexpected event network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 for instance with vm_state building and task_state spawning.
Aug 27 05:14:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:14:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:50 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:14:50 user nova-compute[72904]: INFO nova.compute.claims [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Claim successful on node user
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.network.neutron [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.policy [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a89184799414da9ac135289cc4781ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a569f1146db846d7aabf09b5ca515d2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Creating image(s)
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "/opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "/opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "/opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113291.588605, be32e4e5-ed6d-4569-88a2-8fb43041e51e => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] VM Resumed (Lifecycle Event)
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Instance spawned successfully.
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113291.598973, be32e4e5-ed6d-4569-88a2-8fb43041e51e => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] VM Started (Lifecycle Event)
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Took 6.51 seconds to spawn the instance on the hypervisor.
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:14:51 user nova-compute[72904]: INFO nova.compute.manager [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Took 7.35 seconds to build instance.
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8be8b6ad-6a58-499f-8af2-fbf870c5535f tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.450s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-214dcd12-ce5c-44f1-8cf3-7f9685f34a81 req-6480352e-4d12-4478-b86c-930e328b1c31 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-214dcd12-ce5c-44f1-8cf3-7f9685f34a81 req-6480352e-4d12-4478-b86c-930e328b1c31 service nova] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-214dcd12-ce5c-44f1-8cf3-7f9685f34a81 req-6480352e-4d12-4478-b86c-930e328b1c31 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-214dcd12-ce5c-44f1-8cf3-7f9685f34a81 req-6480352e-4d12-4478-b86c-930e328b1c31 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-214dcd12-ce5c-44f1-8cf3-7f9685f34a81 req-6480352e-4d12-4478-b86c-930e328b1c31 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] No waiting events found dispatching network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:14:51 user nova-compute[72904]: WARNING nova.compute.manager [req-214dcd12-ce5c-44f1-8cf3-7f9685f34a81 req-6480352e-4d12-4478-b86c-930e328b1c31 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received unexpected event network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 for instance with vm_state active and task_state None.
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk 1073741824" returned: 0 in 0.054s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG nova.network.neutron [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Successfully created port: b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Cannot resize image /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Ensure instance console log exists: /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Successfully updated port: b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquired lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-changed-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Refreshing instance network info cache due to event network-changed-b64e969b-aacc-4d31-8acf-46ad4e0fa40e. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] Acquiring lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updating instance_info_cache with network_info: [{"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Releasing lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Instance network_info: |[{"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] Acquired lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Refreshing network info cache for port b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Start _get_guest_xml network_info=[{"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:14:53 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:53 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1543510016',display_name='tempest-AttachVolumeTestJSON-server-1543510016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1543510016',id=31,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/pmgOxj+fDsZA+2YZ7gNHUZAlN99S8+jKflc0h9qgtBcdwOCiZCQR+NnQluFS/0fkV1NJmPC63zIuBzFc9bqoi0ezWWA11Jhf9MQjMpkfbApo20fp9wavZPTvc2j1ttw==',key_name='tempest-keypair-399054024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-vj07d2pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a1:2a,bridge_name='br-int',has_traffic_filtering=True,id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64e969b-aa') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.objects.instance [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'pci_devices' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:14:53 user nova-compute[72904]:   <uuid>52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8</uuid>
Aug 27 05:14:53 user nova-compute[72904]:   <name>instance-0000001f</name>
Aug 27 05:14:53 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:14:53 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:14:53 user nova-compute[72904]:   <metadata>
Aug 27 05:14:53 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:14:53 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:14:53 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeTestJSON-server-1543510016</nova:name>
Aug 27 05:14:53 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:14:53</nova:creationTime>
Aug 27 05:14:53 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:14:53 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:14:53 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:14:53 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:14:53 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:14:53 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:14:53 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:14:53 user nova-compute[72904]:       <nova:owner>
Aug 27 05:14:53 user nova-compute[72904]:         <nova:user uuid="7a89184799414da9ac135289cc4781ed">tempest-AttachVolumeTestJSON-111990947-project-member</nova:user>
Aug 27 05:14:53 user nova-compute[72904]:         <nova:project uuid="a569f1146db846d7aabf09b5ca515d2d">tempest-AttachVolumeTestJSON-111990947</nova:project>
Aug 27 05:14:53 user nova-compute[72904]:       </nova:owner>
Aug 27 05:14:53 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:14:53 user nova-compute[72904]:       <nova:ports>
Aug 27 05:14:53 user nova-compute[72904]:         <nova:port uuid="b64e969b-aacc-4d31-8acf-46ad4e0fa40e">
Aug 27 05:14:53 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 05:14:53 user nova-compute[72904]:         </nova:port>
Aug 27 05:14:53 user nova-compute[72904]:       </nova:ports>
Aug 27 05:14:53 user nova-compute[72904]:     </nova:instance>
Aug 27 05:14:53 user nova-compute[72904]:   </metadata>
Aug 27 05:14:53 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:14:53 user nova-compute[72904]:     <system>
Aug 27 05:14:53 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:14:53 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:14:53 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:14:53 user nova-compute[72904]:       <entry name="serial">52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8</entry>
Aug 27 05:14:53 user nova-compute[72904]:       <entry name="uuid">52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8</entry>
Aug 27 05:14:53 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:14:53 user nova-compute[72904]:     </system>
Aug 27 05:14:53 user nova-compute[72904]:   </sysinfo>
Aug 27 05:14:53 user nova-compute[72904]:   <os>
Aug 27 05:14:53 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:14:53 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:14:53 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:14:53 user nova-compute[72904]:   </os>
Aug 27 05:14:53 user nova-compute[72904]:   <features>
Aug 27 05:14:53 user nova-compute[72904]:     <acpi/>
Aug 27 05:14:53 user nova-compute[72904]:     <apic/>
Aug 27 05:14:53 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:14:53 user nova-compute[72904]:   </features>
Aug 27 05:14:53 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:14:53 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:14:53 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:14:53 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:14:53 user nova-compute[72904]:   </clock>
Aug 27 05:14:53 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:14:53 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:14:53 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:14:53 user nova-compute[72904]:   </cpu>
Aug 27 05:14:53 user nova-compute[72904]:   <devices>
Aug 27 05:14:53 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:14:53 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:14:53 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk"/>
Aug 27 05:14:53 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:14:53 user nova-compute[72904]:     </disk>
Aug 27 05:14:53 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:14:53 user nova-compute[72904]:       <mac address="fa:16:3e:cc:a1:2a"/>
Aug 27 05:14:53 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:14:53 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:14:53 user nova-compute[72904]:       <target dev="tapb64e969b-aa"/>
Aug 27 05:14:53 user nova-compute[72904]:     </interface>
Aug 27 05:14:53 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:14:53 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/console.log" append="off"/>
Aug 27 05:14:53 user nova-compute[72904]:     </serial>
Aug 27 05:14:53 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:14:53 user nova-compute[72904]:     <video>
Aug 27 05:14:53 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:14:53 user nova-compute[72904]:     </video>
Aug 27 05:14:53 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:14:53 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:14:53 user nova-compute[72904]:     </rng>
Aug 27 05:14:53 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:14:53 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:14:53 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:14:53 user nova-compute[72904]:     </memballoon>
Aug 27 05:14:53 user nova-compute[72904]:   </devices>
Aug 27 05:14:53 user nova-compute[72904]: </domain>
Aug 27 05:14:53 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1543510016',display_name='tempest-AttachVolumeTestJSON-server-1543510016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1543510016',id=31,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/pmgOxj+fDsZA+2YZ7gNHUZAlN99S8+jKflc0h9qgtBcdwOCiZCQR+NnQluFS/0fkV1NJmPC63zIuBzFc9bqoi0ezWWA11Jhf9MQjMpkfbApo20fp9wavZPTvc2j1ttw==',key_name='tempest-keypair-399054024',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-vj07d2pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:14:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a1:2a,bridge_name='br-int',has_traffic_filtering=True,id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64e969b-aa') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG os_vif [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a1:2a,bridge_name='br-int',has_traffic_filtering=True,id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64e969b-aa') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb64e969b-aa, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb64e969b-aa, col_values=(('external_ids', {'iface-id': 'b64e969b-aacc-4d31-8acf-46ad4e0fa40e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:a1:2a', 'vm-uuid': '52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:53 user nova-compute[72904]: INFO os_vif [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:a1:2a,bridge_name='br-int',has_traffic_filtering=True,id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64e969b-aa')
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:14:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No VIF found with MAC fa:16:3e:cc:a1:2a, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:14:54 user nova-compute[72904]: DEBUG nova.network.neutron [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updated VIF entry in instance network info cache for port b64e969b-aacc-4d31-8acf-46ad4e0fa40e. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:14:54 user nova-compute[72904]: DEBUG nova.network.neutron [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updating instance_info_cache with network_info: [{"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:14:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6c8ab491-ada2-40f6-8ed2-408cd4bd5b15 req-55c30b2e-8435-4ade-b832-6c0e73048552 service nova] Releasing lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-48ed7de9-b1fb-425e-ab1f-4c84eb36597c req-8958feff-1525-4542-b51e-f06d369ea662 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48ed7de9-b1fb-425e-ab1f-4c84eb36597c req-8958feff-1525-4542-b51e-f06d369ea662 service nova] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48ed7de9-b1fb-425e-ab1f-4c84eb36597c req-8958feff-1525-4542-b51e-f06d369ea662 service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-48ed7de9-b1fb-425e-ab1f-4c84eb36597c req-8958feff-1525-4542-b51e-f06d369ea662 service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-48ed7de9-b1fb-425e-ab1f-4c84eb36597c req-8958feff-1525-4542-b51e-f06d369ea662 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] No waiting events found dispatching network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:14:55 user nova-compute[72904]: WARNING nova.compute.manager [req-48ed7de9-b1fb-425e-ab1f-4c84eb36597c req-8958feff-1525-4542-b51e-f06d369ea662 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received unexpected event network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e for instance with vm_state building and task_state spawning.
Aug 27 05:14:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113297.3855653, 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:14:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] VM Resumed (Lifecycle Event)
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Instance spawned successfully.
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:14:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113297.3947425, 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:14:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] VM Started (Lifecycle Event)
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:14:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:14:57 user nova-compute[72904]: INFO nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-9f7e87fb-25de-4dfc-8b06-f770f995f2cc req-0bedda96-1c52-4f99-864f-a4eb30855abe service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9f7e87fb-25de-4dfc-8b06-f770f995f2cc req-0bedda96-1c52-4f99-864f-a4eb30855abe service nova] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9f7e87fb-25de-4dfc-8b06-f770f995f2cc req-0bedda96-1c52-4f99-864f-a4eb30855abe service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9f7e87fb-25de-4dfc-8b06-f770f995f2cc req-0bedda96-1c52-4f99-864f-a4eb30855abe service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-9f7e87fb-25de-4dfc-8b06-f770f995f2cc req-0bedda96-1c52-4f99-864f-a4eb30855abe service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] No waiting events found dispatching network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:14:57 user nova-compute[72904]: WARNING nova.compute.manager [req-9f7e87fb-25de-4dfc-8b06-f770f995f2cc req-0bedda96-1c52-4f99-864f-a4eb30855abe service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received unexpected event network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e for instance with vm_state building and task_state spawning.
Aug 27 05:14:57 user nova-compute[72904]: INFO nova.compute.manager [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Took 6.88 seconds to build instance.
Aug 27 05:14:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-58d46694-4b05-47e5-9e30-774d79798a15 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.978s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:14:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:05 user nova-compute[72904]: INFO nova.compute.manager [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Detaching volume 15f3bc2d-094c-47e8-b92b-ecc4a13c1709
Aug 27 05:15:05 user nova-compute[72904]: INFO nova.virt.block_device [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Attempting to driver detach volume 15f3bc2d-094c-47e8-b92b-ecc4a13c1709 from mountpoint /dev/vdb
Aug 27 05:15:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Attempting to detach device vdb from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:15:05 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:15:05 user nova-compute[72904]:   <source dev="/dev/sdf"/>
Aug 27 05:15:05 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:15:05 user nova-compute[72904]:   <serial>15f3bc2d-094c-47e8-b92b-ecc4a13c1709</serial>
Aug 27 05:15:05 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:15:05 user nova-compute[72904]: </disk>
Aug 27 05:15:05 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:15:05 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Successfully detached device vdb from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the persistent domain config.
Aug 27 05:15:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:15:05 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:15:05 user nova-compute[72904]:   <source dev="/dev/sdf"/>
Aug 27 05:15:05 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:15:05 user nova-compute[72904]:   <serial>15f3bc2d-094c-47e8-b92b-ecc4a13c1709</serial>
Aug 27 05:15:05 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:15:05 user nova-compute[72904]: </disk>
Aug 27 05:15:05 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113305.8201632, 8b96c2eb-dd8b-4d42-94de-dab850795ecd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:15:05 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Successfully detached device vdb from instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd from the live domain config.
Aug 27 05:15:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GOEChZeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:15:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[167614d2-4a09-4476-ad05-adf4324d6d7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dce306-17ab-43f1-aedd-e4dcc0d044b9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:05 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:15:05 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:15:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:05 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:15:05 user nova-compute[72904]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 (non-flash)
Aug 27 05:15:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c643520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709'): ({'sdf'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Removing single pathed devices sdf {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8472fb-6c0a-4a5c-82bb-d37ea3fe0ab4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d423a5-240d-47c3-8e19-1493f8836d42]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Flushing IO for device /dev/sdf {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2939a4b-12df-441b-b0cc-687170703822]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:15:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc0a608-2b95-42f9-af88-4e35d0ef32ce]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c9281-7564-488e-8e47-30a271f60540]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d7053a-bc07-4fd5-af47-99658fe426e7]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260]
Aug 27 05:15:06 user nova-compute[72904]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709, portal: 172.16.0.220,3260] successful.
Aug 27 05:15:06 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15f3bc2d-094c-47e8-b92b-ecc4a13c1709 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5355f-cd56-4801-a0f0-c2082a78ad2c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] <== disconnect_volume: return (342ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:15:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:15:07 user nova-compute[72904]: DEBUG nova.objects.instance [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'flavor' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0301e524-4faa-498d-898c-52f706a5366b tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.933s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:14 user nova-compute[72904]: INFO nova.compute.manager [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Terminating instance
Aug 27 05:15:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-8ca7c4f3-7678-4a05-8071-c30a5e3fe72e req-3677d92f-20ce-4bfb-ab3e-1cbe5ec417cd service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-unplugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8ca7c4f3-7678-4a05-8071-c30a5e3fe72e req-3677d92f-20ce-4bfb-ab3e-1cbe5ec417cd service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8ca7c4f3-7678-4a05-8071-c30a5e3fe72e req-3677d92f-20ce-4bfb-ab3e-1cbe5ec417cd service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8ca7c4f3-7678-4a05-8071-c30a5e3fe72e req-3677d92f-20ce-4bfb-ab3e-1cbe5ec417cd service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-8ca7c4f3-7678-4a05-8071-c30a5e3fe72e req-3677d92f-20ce-4bfb-ab3e-1cbe5ec417cd service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-unplugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-8ca7c4f3-7678-4a05-8071-c30a5e3fe72e req-3677d92f-20ce-4bfb-ab3e-1cbe5ec417cd service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-unplugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Instance destroyed successfully.
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'resources' on Instance uuid f8dad8d9-a024-4f25-b1fa-52424b79b662 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:08:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-413967328',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-413967328',id=23,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFku25PHmoznQMdudBzjCXX/wLaRl7v7i6gLmaYKiZO6y2ja27uNo/ZvfHD5Y1lw+O/TAAKEsczYCaWj1NTWE1JuUOay9FWnNSMtYenwgtjIhxOEc25uPhOzioyDsk9ig==',key_name='tempest-keypair-272173837',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:12:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-gy814sik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=f8dad8d9-a024-4f25-b1fa-52424b79b662,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "3874404d-4f70-43f4-b56b-5d7368b97827", "address": "fa:16:3e:5b:e0:b5", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3874404d-4f", "ovs_interfaceid": "3874404d-4f70-43f4-b56b-5d7368b97827", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG os_vif [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3874404d-4f, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:15 user nova-compute[72904]: INFO os_vif [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:e0:b5,bridge_name='br-int',has_traffic_filtering=True,id=3874404d-4f70-43f4-b56b-5d7368b97827,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3874404d-4f')
Aug 27 05:15:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Deleting instance files /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662_del
Aug 27 05:15:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Deletion of /opt/stack/data/nova/instances/f8dad8d9-a024-4f25-b1fa-52424b79b662_del complete
Aug 27 05:15:15 user nova-compute[72904]: INFO nova.compute.manager [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 27 05:15:15 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:15:15 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:15:16 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:15:16 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Took 0.85 seconds to deallocate network for instance.
Aug 27 05:15:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:16 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:15:16 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:15:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:16 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Deleted allocations for instance f8dad8d9-a024-4f25-b1fa-52424b79b662
Aug 27 05:15:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f7e800c-c883-4c53-911d-c2f6f893bf6f tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.355s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-480c9a5a-9a51-4595-aec4-dfd313150fff req-8b2f00e7-3cf1-4255-a450-0aaba60b89f0 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-480c9a5a-9a51-4595-aec4-dfd313150fff req-8b2f00e7-3cf1-4255-a450-0aaba60b89f0 service nova] Acquiring lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-480c9a5a-9a51-4595-aec4-dfd313150fff req-8b2f00e7-3cf1-4255-a450-0aaba60b89f0 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-480c9a5a-9a51-4595-aec4-dfd313150fff req-8b2f00e7-3cf1-4255-a450-0aaba60b89f0 service nova] Lock "f8dad8d9-a024-4f25-b1fa-52424b79b662-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-480c9a5a-9a51-4595-aec4-dfd313150fff req-8b2f00e7-3cf1-4255-a450-0aaba60b89f0 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] No waiting events found dispatching network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:17 user nova-compute[72904]: WARNING nova.compute.manager [req-480c9a5a-9a51-4595-aec4-dfd313150fff req-8b2f00e7-3cf1-4255-a450-0aaba60b89f0 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received unexpected event network-vif-plugged-3874404d-4f70-43f4-b56b-5d7368b97827 for instance with vm_state deleted and task_state None.
Aug 27 05:15:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-480c9a5a-9a51-4595-aec4-dfd313150fff req-8b2f00e7-3cf1-4255-a450-0aaba60b89f0 service nova] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Received event network-vif-deleted-3874404d-4f70-43f4-b56b-5d7368b97827 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:23 user nova-compute[72904]: INFO nova.compute.manager [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Detaching volume 7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b
Aug 27 05:15:23 user nova-compute[72904]: INFO nova.virt.block_device [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Attempting to driver detach volume 7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b from mountpoint /dev/vdb
Aug 27 05:15:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Attempting to detach device vdb from instance e8403a20-3d6b-4897-b697-fdb1e7722e4f from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:15:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:15:23 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:15:23 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:15:23 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:15:23 user nova-compute[72904]:   <serial>7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b</serial>
Aug 27 05:15:23 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:15:23 user nova-compute[72904]: </disk>
Aug 27 05:15:23 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:15:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully detached device vdb from instance e8403a20-3d6b-4897-b697-fdb1e7722e4f from the persistent domain config.
Aug 27 05:15:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8403a20-3d6b-4897-b697-fdb1e7722e4f from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:15:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:15:23 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:15:23 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:15:23 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:15:23 user nova-compute[72904]:   <serial>7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b</serial>
Aug 27 05:15:23 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 27 05:15:23 user nova-compute[72904]: </disk>
Aug 27 05:15:23 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113324.112563, e8403a20-3d6b-4897-b697-fdb1e7722e4f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:15:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully detached device vdb from instance e8403a20-3d6b-4897-b697-fdb1e7722e4f from the live domain config.
Aug 27 05:15:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgopYayh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:15:24 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c687cc88-71f2-4ed9-894e-9e110d19dca7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[19547994-2d26-41f5-9c6e-c033e4510963]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:24 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:15:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:24 user nova-compute[72904]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b (non-flash)
Aug 27 05:15:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c5d0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a2e4f9-f239-42e0-b049-643948f9fcd7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7250ba-8c26-4317-8f6d-921bc20b373a]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7798c-1a5a-49b1-8012-f518d5e4fd79]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10ff2a9-7ceb-49a2-8914-888efd2f73e0]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9565f75d-d27f-4ad6-88ed-3d522dccadd1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7f671f-ae4b-43c0-950b-6df5a492a9a2]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260]
Aug 27 05:15:24 user nova-compute[72904]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b, portal: 172.16.0.220,3260] successful.
Aug 27 05:15:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e427293-3a65-4c6a-8ae2-d0eaf4e56d9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d8807-8542-49e0-8aec-ade95b400fd4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.236s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== disconnect_volume: return (237ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:15:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:15:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:27 user nova-compute[72904]: DEBUG nova.objects.instance [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'flavor' on Instance uuid e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0835c70b-0d0b-49ff-9525-8434436a649b tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.262s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:28 user nova-compute[72904]: INFO nova.compute.manager [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Terminating instance
Aug 27 05:15:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-97912410-4fb3-4c59-96a9-bc4d8deeae40 req-ecf8164c-bf7f-428f-bad6-c4cbd301063f service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-unplugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97912410-4fb3-4c59-96a9-bc4d8deeae40 req-ecf8164c-bf7f-428f-bad6-c4cbd301063f service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97912410-4fb3-4c59-96a9-bc4d8deeae40 req-ecf8164c-bf7f-428f-bad6-c4cbd301063f service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97912410-4fb3-4c59-96a9-bc4d8deeae40 req-ecf8164c-bf7f-428f-bad6-c4cbd301063f service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-97912410-4fb3-4c59-96a9-bc4d8deeae40 req-ecf8164c-bf7f-428f-bad6-c4cbd301063f service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-unplugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-97912410-4fb3-4c59-96a9-bc4d8deeae40 req-ecf8164c-bf7f-428f-bad6-c4cbd301063f service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-unplugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:15:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Instance destroyed successfully.
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'resources' on Instance uuid 12852d71-dd0e-46da-8b7b-674551d62f3c {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-154298842',display_name='tempest-TestMinimumBasicScenario-server-154298842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-154298842',id=24,image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmC2e4T98duKpEp83AKEXonLXloh9t/Zb4XOyE6f2eNex/52u+CTWLoC4QbEk/hmnUlfYO/JWFIvfdStE4ntnvvJR4gBuBWUix8fpcaPWlkcm+9eIqAhKBstI+lWg7Cnw==',key_name='tempest-TestMinimumBasicScenario-1793810962',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-09cesfte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='0fd57a5a-c9c1-4a65-bef1-ef1b857b15c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:12:44Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=12852d71-dd0e-46da-8b7b-674551d62f3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "address": "fa:16:3e:4f:23:09", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a8c4683-48", "ovs_interfaceid": "9a8c4683-4885-4a6e-8832-bf0bb7d96111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG os_vif [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a8c4683-48, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:15:29 user nova-compute[72904]: INFO os_vif [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:23:09,bridge_name='br-int',has_traffic_filtering=True,id=9a8c4683-4885-4a6e-8832-bf0bb7d96111,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a8c4683-48')
Aug 27 05:15:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Deleting instance files /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c_del
Aug 27 05:15:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Deletion of /opt/stack/data/nova/instances/12852d71-dd0e-46da-8b7b-674551d62f3c_del complete
Aug 27 05:15:29 user nova-compute[72904]: INFO nova.compute.manager [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-03e71c5f-265c-423d-aec4-bf34ccdd4952 req-c7058337-ff46-4d94-89b9-775e29f84e0d service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-deleted-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:29 user nova-compute[72904]: INFO nova.compute.manager [req-03e71c5f-265c-423d-aec4-bf34ccdd4952 req-c7058337-ff46-4d94-89b9-775e29f84e0d service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Neutron deleted interface 9a8c4683-4885-4a6e-8832-bf0bb7d96111; detaching it from the instance and deleting it from the info cache
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-03e71c5f-265c-423d-aec4-bf34ccdd4952 req-c7058337-ff46-4d94-89b9-775e29f84e0d service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:15:29 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Took 0.58 seconds to deallocate network for instance.
Aug 27 05:15:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-03e71c5f-265c-423d-aec4-bf34ccdd4952 req-c7058337-ff46-4d94-89b9-775e29f84e0d service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Detach interface failed, port_id=9a8c4683-4885-4a6e-8832-bf0bb7d96111, reason: Instance 12852d71-dd0e-46da-8b7b-674551d62f3c could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.574s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:30 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Deleted allocations for instance 12852d71-dd0e-46da-8b7b-674551d62f3c
Aug 27 05:15:30 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113315.4275815, f8dad8d9-a024-4f25-b1fa-52424b79b662 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:15:30 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] VM Stopped (Lifecycle Event)
Aug 27 05:15:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0bf793f4-a659-4242-9d88-a117d297f2b7 None None] [instance: f8dad8d9-a024-4f25-b1fa-52424b79b662] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1b9a3495-7a5f-465f-bcc9-1573f6510667 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e4d7ded-df9f-44fa-9684-1eae0fd144a7 req-715571dd-457d-4fea-a04f-52e22faee416 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e4d7ded-df9f-44fa-9684-1eae0fd144a7 req-715571dd-457d-4fea-a04f-52e22faee416 service nova] Acquiring lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e4d7ded-df9f-44fa-9684-1eae0fd144a7 req-715571dd-457d-4fea-a04f-52e22faee416 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e4d7ded-df9f-44fa-9684-1eae0fd144a7 req-715571dd-457d-4fea-a04f-52e22faee416 service nova] Lock "12852d71-dd0e-46da-8b7b-674551d62f3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e4d7ded-df9f-44fa-9684-1eae0fd144a7 req-715571dd-457d-4fea-a04f-52e22faee416 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] No waiting events found dispatching network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:30 user nova-compute[72904]: WARNING nova.compute.manager [req-0e4d7ded-df9f-44fa-9684-1eae0fd144a7 req-715571dd-457d-4fea-a04f-52e22faee416 service nova] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Received unexpected event network-vif-plugged-9a8c4683-4885-4a6e-8832-bf0bb7d96111 for instance with vm_state deleted and task_state None.
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:15:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7154MB free_disk=25.158035278320312GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance e8403a20-3d6b-4897-b697-fdb1e7722e4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance be32e4e5-ed6d-4569-88a2-8fb43041e51e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:15:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing instance network info cache due to event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] Acquiring lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] Acquired lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG nova.objects.instance [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'flavor' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:36 user nova-compute[72904]: INFO nova.compute.manager [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Attaching volume 670d66ae-d874-429a-a940-1ccb80917cb6 to /dev/vdb
Aug 27 05:15:36 user nova-compute[72904]: DEBUG os_brick.utils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d169881b-ee22-4ea6-8279-f679afde725b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updated VIF entry in instance network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb41df82-9148-4717-8d87-cffcc20e855a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-18953457-15ae-46db-89ff-20e20391d2ec req-ba96ceda-97a0-4ef6-9646-788d1a37ba0a service nova] Releasing lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdf85b0-5a45-444f-9f05-013737189e70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[683e3220-30bc-46c4-b142-4c32aaf2f59c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:15:36 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:15:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[023f3a36-fbbe-4aa0-9752-d6233cd51d00]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG os_brick.utils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating existing volume attachment record: ffb06cfb-76aa-428f-8274-f432e138543d {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:15:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:15:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:15:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:15:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:15:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:15:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:44 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113329.009554, 12852d71-dd0e-46da-8b7b-674551d62f3c => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:15:44 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] VM Stopped (Lifecycle Event)
Aug 27 05:15:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c408a09c-c063-4d6d-9f99-4498fb0eb0a9 None None] [instance: 12852d71-dd0e-46da-8b7b-674551d62f3c] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:15:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOIhgCHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:15:47 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:15:47 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:15:47 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5768bc88-9a8c-4388-9056-5643fc1f8527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:15:47 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc72f1a-5714-4f7e-bc35-ad34a66ee349]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6] added
Aug 27 05:15:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0aa947-9661-40e2-b934-479cd31e9000]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31d2807-dd0b-4a43-9f6d-41f890216629]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOIhgCHP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jOIhgCHP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[310e3a4b-db83-45bb-807a-b007c2e6e776]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jOIhgCHP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee91ede3-f84b-48ee-add8-cf2f40bd6e6a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[48515051-dfa9-473a-b055-f021e7469d0f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcddbcf0-bb12-408e-bb3d-6918ad8818c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260]
Aug 27 05:15:47 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260] successful.
Aug 27 05:15:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb974de9-3e07-4be0-b844-1d490bfedc55]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8decc35d-3657-4772-9f33-adcca6addae7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:47 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:15:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:15:47 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:15:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa7932-8c99-4e26-b475-0152053774b4]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:15:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOIhgCHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:15:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:15:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23764373764393532', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:15:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764373764393532', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:15:48 user nova-compute[72904]: DEBUG nova.objects.instance [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'flavor' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:15:49 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:15:49 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:15:49 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:15:49 user nova-compute[72904]:   <serial>670d66ae-d874-429a-a940-1ccb80917cb6</serial>
Aug 27 05:15:49 user nova-compute[72904]: </disk>
Aug 27 05:15:49 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:15:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:15:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:15:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No VIF found with MAC fa:16:3e:f3:53:c0, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:15:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-da3b687c-2e2c-43e0-9f63-b5590f929d86 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.125s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:50 user nova-compute[72904]: INFO nova.compute.manager [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Rescuing
Aug 27 05:15:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:15:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:15:50 user nova-compute[72904]: DEBUG nova.network.neutron [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG nova.network.neutron [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-5848e9af-9386-4fc6-8851-e1d38ed01d01 req-c3a707c5-3172-4f66-bc57-bbf9d1f40b36 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5848e9af-9386-4fc6-8851-e1d38ed01d01 req-c3a707c5-3172-4f66-bc57-bbf9d1f40b36 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5848e9af-9386-4fc6-8851-e1d38ed01d01 req-c3a707c5-3172-4f66-bc57-bbf9d1f40b36 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5848e9af-9386-4fc6-8851-e1d38ed01d01 req-c3a707c5-3172-4f66-bc57-bbf9d1f40b36 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-5848e9af-9386-4fc6-8851-e1d38ed01d01 req-c3a707c5-3172-4f66-bc57-bbf9d1f40b36 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:51 user nova-compute[72904]: WARNING nova.compute.manager [req-5848e9af-9386-4fc6-8851-e1d38ed01d01 req-c3a707c5-3172-4f66-bc57-bbf9d1f40b36 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state active and task_state rescuing.
Aug 27 05:15:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance destroyed successfully.
Aug 27 05:15:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Attempting rescue
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72904) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:15:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Creating image(s)
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue" returned: 0 in 0.053s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'migration_context' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.base [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Start _get_guest_xml network_info=[{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:f3:53:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'resources' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.base [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'numa_topology' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.base [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:15:52 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:15:52 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.base [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-964941530',display_name='tempest-ServerRescueNegativeTestJSON-server-964941530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-964941530',id=28,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCwGsbTWKclBmdJpysTtFepyuf/r32Xo/ACVhO6iycF8/M0FEO8SOaca+JxtvLJeqK29+Mqn/TLgD6cDUZJZuegZiX7Oh/SnEAFe/0bF69k9zC0QmLZ75dZPHWAlh9wvQ==',key_name='tempest-keypair-1522623289',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:13:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-yqjvoune',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:13:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='223d760d5f03408781a9241f98a5a6c8',uuid=6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:f3:53:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "vif_mac": "fa:16:3e:f3:53:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.objects.base [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Object Instance<6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:15:52 user nova-compute[72904]:   <uuid>6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049</uuid>
Aug 27 05:15:52 user nova-compute[72904]:   <name>instance-0000001c</name>
Aug 27 05:15:52 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:15:52 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:15:52 user nova-compute[72904]:   <metadata>
Aug 27 05:15:52 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:15:52 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:15:52 user nova-compute[72904]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-964941530</nova:name>
Aug 27 05:15:52 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:15:52</nova:creationTime>
Aug 27 05:15:52 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:15:52 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:15:52 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:15:52 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:15:52 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:15:52 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:15:52 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:15:52 user nova-compute[72904]:       <nova:owner>
Aug 27 05:15:52 user nova-compute[72904]:         <nova:user uuid="223d760d5f03408781a9241f98a5a6c8">tempest-ServerRescueNegativeTestJSON-275121126-project-member</nova:user>
Aug 27 05:15:52 user nova-compute[72904]:         <nova:project uuid="1b16eb565e64463c9a6e61ddcad25728">tempest-ServerRescueNegativeTestJSON-275121126</nova:project>
Aug 27 05:15:52 user nova-compute[72904]:       </nova:owner>
Aug 27 05:15:52 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:15:52 user nova-compute[72904]:       <nova:ports>
Aug 27 05:15:52 user nova-compute[72904]:         <nova:port uuid="cc57cb58-ff4a-41a2-a902-9691bd2c9217">
Aug 27 05:15:52 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 05:15:52 user nova-compute[72904]:         </nova:port>
Aug 27 05:15:52 user nova-compute[72904]:       </nova:ports>
Aug 27 05:15:52 user nova-compute[72904]:     </nova:instance>
Aug 27 05:15:52 user nova-compute[72904]:   </metadata>
Aug 27 05:15:52 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:15:52 user nova-compute[72904]:     <system>
Aug 27 05:15:52 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:15:52 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:15:52 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:15:52 user nova-compute[72904]:       <entry name="serial">6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049</entry>
Aug 27 05:15:52 user nova-compute[72904]:       <entry name="uuid">6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049</entry>
Aug 27 05:15:52 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:15:52 user nova-compute[72904]:     </system>
Aug 27 05:15:52 user nova-compute[72904]:   </sysinfo>
Aug 27 05:15:52 user nova-compute[72904]:   <os>
Aug 27 05:15:52 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:15:52 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:15:52 user nova-compute[72904]:   </os>
Aug 27 05:15:52 user nova-compute[72904]:   <features>
Aug 27 05:15:52 user nova-compute[72904]:     <acpi/>
Aug 27 05:15:52 user nova-compute[72904]:     <apic/>
Aug 27 05:15:52 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:15:52 user nova-compute[72904]:   </features>
Aug 27 05:15:52 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:15:52 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:15:52 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:15:52 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:15:52 user nova-compute[72904]:   </clock>
Aug 27 05:15:52 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:15:52 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:15:52 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:15:52 user nova-compute[72904]:   </cpu>
Aug 27 05:15:52 user nova-compute[72904]:   <devices>
Aug 27 05:15:52 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:15:52 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:15:52 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue"/>
Aug 27 05:15:52 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:15:52 user nova-compute[72904]:     </disk>
Aug 27 05:15:52 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:15:52 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:15:52 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk"/>
Aug 27 05:15:52 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:15:52 user nova-compute[72904]:     </disk>
Aug 27 05:15:52 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:15:52 user nova-compute[72904]:       <mac address="fa:16:3e:f3:53:c0"/>
Aug 27 05:15:52 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:15:52 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:15:52 user nova-compute[72904]:       <target dev="tapcc57cb58-ff"/>
Aug 27 05:15:52 user nova-compute[72904]:     </interface>
Aug 27 05:15:52 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:15:52 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/console.log" append="off"/>
Aug 27 05:15:52 user nova-compute[72904]:     </serial>
Aug 27 05:15:52 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:15:52 user nova-compute[72904]:     <video>
Aug 27 05:15:52 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:15:52 user nova-compute[72904]:     </video>
Aug 27 05:15:52 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:15:52 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:15:52 user nova-compute[72904]:     </rng>
Aug 27 05:15:52 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:15:52 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:15:52 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:15:52 user nova-compute[72904]:     </memballoon>
Aug 27 05:15:52 user nova-compute[72904]:   </devices>
Aug 27 05:15:52 user nova-compute[72904]: </domain>
Aug 27 05:15:52 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:15:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance destroyed successfully.
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:15:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] No VIF found with MAC fa:16:3e:f3:53:c0, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1781f1-c14d-4884-b379-f8cea461df8f req-f97ecb0c-351a-43fe-a0d1-537e4e9634e4 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8c1781f1-c14d-4884-b379-f8cea461df8f req-f97ecb0c-351a-43fe-a0d1-537e4e9634e4 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8c1781f1-c14d-4884-b379-f8cea461df8f req-f97ecb0c-351a-43fe-a0d1-537e4e9634e4 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8c1781f1-c14d-4884-b379-f8cea461df8f req-f97ecb0c-351a-43fe-a0d1-537e4e9634e4 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-8c1781f1-c14d-4884-b379-f8cea461df8f req-f97ecb0c-351a-43fe-a0d1-537e4e9634e4 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:53 user nova-compute[72904]: WARNING nova.compute.manager [req-8c1781f1-c14d-4884-b379-f8cea461df8f req-f97ecb0c-351a-43fe-a0d1-537e4e9634e4 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state active and task_state rescuing.
Aug 27 05:15:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:55 user nova-compute[72904]: INFO nova.compute.manager [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Terminating instance
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:55 user nova-compute[72904]: WARNING nova.compute.manager [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state active and task_state rescuing.
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:55 user nova-compute[72904]: WARNING nova.compute.manager [req-c2f8cabd-79ee-4c79-8320-cda759f71db5 req-08ecb4a9-6ea8-4cb7-84d8-d31cbd5c5634 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state active and task_state rescuing.
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-16010f91-8b07-46cf-9a28-782878c3a421 req-f13b7b24-c80b-4342-8676-4a3dd354a783 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-vif-unplugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-16010f91-8b07-46cf-9a28-782878c3a421 req-f13b7b24-c80b-4342-8676-4a3dd354a783 service nova] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-16010f91-8b07-46cf-9a28-782878c3a421 req-f13b7b24-c80b-4342-8676-4a3dd354a783 service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-16010f91-8b07-46cf-9a28-782878c3a421 req-f13b7b24-c80b-4342-8676-4a3dd354a783 service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-16010f91-8b07-46cf-9a28-782878c3a421 req-f13b7b24-c80b-4342-8676-4a3dd354a783 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] No waiting events found dispatching network-vif-unplugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-16010f91-8b07-46cf-9a28-782878c3a421 req-f13b7b24-c80b-4342-8676-4a3dd354a783 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-vif-unplugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113356.0293546, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:15:56 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] VM Resumed (Lifecycle Event)
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-437f26e6-9ff8-4249-968a-3c8cb5f9c4e4 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113356.0305254, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:15:56 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] VM Started (Lifecycle Event)
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:15:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Instance destroyed successfully.
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lazy-loading 'resources' on Instance uuid 8b96c2eb-dd8b-4d42-94de-dab850795ecd {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1976467830',display_name='tempest-TestServerVolumeAttachmentScenario-server-1976467830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1976467830',id=27,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIMWCgptePRTE0D9cULjtELEFrvjgBqVbtl9MUHuBZ7GifZlADKuhbNiSpRHSYiFOWsCoU7iJN9hLKYx3uAHsCwsaILuUNhr3HOygms8GNu8wcUOaNlGvQZCQXBAnUcMQ==',key_name='tempest-keypair-1041924444',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:11:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e040778d6181423cb5ac0349e1ac1d46',ramdisk_id='',reservation_id='r-jwx3ff88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1750885603',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1750885603-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6670bcb268ea456c90c8b91752f8e1fa',uuid=8b96c2eb-dd8b-4d42-94de-dab850795ecd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Converting VIF {"id": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "address": "fa:16:3e:f2:b9:68", "network": {"id": "90dc5c3c-0e43-4870-837d-a7054d991070", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1528746652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e040778d6181423cb5ac0349e1ac1d46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap811a678a-fd", "ovs_interfaceid": "811a678a-fd9d-44ff-96c5-1a76b0bd0df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:b9:68,bridge_name='br-int',has_traffic_filtering=True,id=811a678a-fd9d-44ff-96c5-1a76b0bd0df3,network=Network(90dc5c3c-0e43-4870-837d-a7054d991070),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811a678a-fd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG os_vif [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:b9:68,bridge_name='br-int',has_traffic_filtering=True,id=811a678a-fd9d-44ff-96c5-1a76b0bd0df3,network=Network(90dc5c3c-0e43-4870-837d-a7054d991070),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811a678a-fd') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap811a678a-fd, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:56 user nova-compute[72904]: INFO os_vif [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:b9:68,bridge_name='br-int',has_traffic_filtering=True,id=811a678a-fd9d-44ff-96c5-1a76b0bd0df3,network=Network(90dc5c3c-0e43-4870-837d-a7054d991070),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap811a678a-fd')
Aug 27 05:15:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Deleting instance files /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd_del
Aug 27 05:15:56 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Deletion of /opt/stack/data/nova/instances/8b96c2eb-dd8b-4d42-94de-dab850795ecd_del complete
Aug 27 05:15:56 user nova-compute[72904]: INFO nova.compute.manager [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 27 05:15:56 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:15:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:15:57 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Took 1.11 seconds to deallocate network for instance.
Aug 27 05:15:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-bb5d9674-f9f3-4f2d-8f47-c9e25492b381 req-ff55aa43-d32d-43ac-ba00-73b7e6ad4a43 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bb5d9674-f9f3-4f2d-8f47-c9e25492b381 req-ff55aa43-d32d-43ac-ba00-73b7e6ad4a43 service nova] Acquiring lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bb5d9674-f9f3-4f2d-8f47-c9e25492b381 req-ff55aa43-d32d-43ac-ba00-73b7e6ad4a43 service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bb5d9674-f9f3-4f2d-8f47-c9e25492b381 req-ff55aa43-d32d-43ac-ba00-73b7e6ad4a43 service nova] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-bb5d9674-f9f3-4f2d-8f47-c9e25492b381 req-ff55aa43-d32d-43ac-ba00-73b7e6ad4a43 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] No waiting events found dispatching network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:15:57 user nova-compute[72904]: WARNING nova.compute.manager [req-bb5d9674-f9f3-4f2d-8f47-c9e25492b381 req-ff55aa43-d32d-43ac-ba00-73b7e6ad4a43 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received unexpected event network-vif-plugged-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 for instance with vm_state deleted and task_state None.
Aug 27 05:15:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-bb5d9674-f9f3-4f2d-8f47-c9e25492b381 req-ff55aa43-d32d-43ac-ba00-73b7e6ad4a43 service nova] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Received event network-vif-deleted-811a678a-fd9d-44ff-96c5-1a76b0bd0df3 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:15:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:57 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Deleted allocations for instance 8b96c2eb-dd8b-4d42-94de-dab850795ecd
Aug 27 05:15:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f698bbff-893c-478b-b0a2-c078ebf37baa tempest-TestServerVolumeAttachmentScenario-1750885603 tempest-TestServerVolumeAttachmentScenario-1750885603-project-member] Lock "8b96c2eb-dd8b-4d42-94de-dab850795ecd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.634s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:15:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:15:59 user nova-compute[72904]: INFO nova.compute.manager [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] instance snapshotting
Aug 27 05:15:59 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Beginning live snapshot process
Aug 27 05:15:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:15:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:15:59 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json -f qcow2 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ne_c1lu/2828c15dbfdb4f1f865a0ec06e50a27e.delta 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9ne_c1lu/2828c15dbfdb4f1f865a0ec06e50a27e.delta 1073741824" returned: 0 in 0.051s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 27 05:16:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:16:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72904) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 27 05:16:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 27 05:16:01 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:16:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ne_c1lu/2828c15dbfdb4f1f865a0ec06e50a27e.delta /opt/stack/data/nova/instances/snapshots/tmp9ne_c1lu/2828c15dbfdb4f1f865a0ec06e50a27e {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9ne_c1lu/2828c15dbfdb4f1f865a0ec06e50a27e.delta /opt/stack/data/nova/instances/snapshots/tmp9ne_c1lu/2828c15dbfdb4f1f865a0ec06e50a27e" returned: 0 in 0.412s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:02 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Snapshot extracted, beginning image upload
Aug 27 05:16:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Snapshot image upload complete
Aug 27 05:16:04 user nova-compute[72904]: INFO nova.compute.manager [None req-d194f2c3-ccb6-4561-a7a5-ea3e6c972c99 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Took 5.39 seconds to snapshot the instance on the hypervisor.
Aug 27 05:16:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:16:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:16:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:16:08 user nova-compute[72904]: INFO nova.compute.claims [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Claim successful on node user
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:16:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.policy [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd521a1e127f496fa4e7865cfedf106f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc9180eede040eaa688e81896d5c3c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:16:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Creating image(s)
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk 1073741824" returned: 0 in 0.052s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Successfully created port: a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Checking if we can resize image /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Cannot resize image /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Ensure instance console log exists: /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Successfully updated port: a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquired lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:16:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing instance network info cache due to event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] Acquiring lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113356.2667522, 8b96c2eb-dd8b-4d42-94de-dab850795ecd => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:16:11 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] VM Stopped (Lifecycle Event)
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-3f5915fc-9640-400e-a997-3a896fdba502 None None] [instance: 8b96c2eb-dd8b-4d42-94de-dab850795ecd] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Releasing lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance network_info: |[{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] Acquired lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Start _get_guest_xml network_info=[{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:16:11 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:16:11 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1446970509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1446970509',id=32,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiQrgc7A7FjqhVOjH4sy6MrmRYpNDFLhOIbKzqYBivxl7GfmXPfG/csWNrDOmp9PJob43UD+0UUaeVIkzTitEjgvxsrO8vRi0Dt1cbc5yB/9L4HLwYYIqo/agkI6byQoQ==',key_name='tempest-keypair-989204785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-ib4vtnbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=103ea467-b0be-4221-81d4-ef2bbbfddc88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.objects.instance [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'pci_devices' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:16:11 user nova-compute[72904]:   <uuid>103ea467-b0be-4221-81d4-ef2bbbfddc88</uuid>
Aug 27 05:16:11 user nova-compute[72904]:   <name>instance-00000020</name>
Aug 27 05:16:11 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:16:11 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:16:11 user nova-compute[72904]:   <metadata>
Aug 27 05:16:11 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:16:11 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:16:11 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1446970509</nova:name>
Aug 27 05:16:11 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:16:11</nova:creationTime>
Aug 27 05:16:11 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:16:11 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:16:11 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:16:11 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:16:11 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:16:11 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:16:11 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:16:11 user nova-compute[72904]:       <nova:owner>
Aug 27 05:16:11 user nova-compute[72904]:         <nova:user uuid="bd521a1e127f496fa4e7865cfedf106f">tempest-AttachVolumeShelveTestJSON-1010055172-project-member</nova:user>
Aug 27 05:16:11 user nova-compute[72904]:         <nova:project uuid="0fc9180eede040eaa688e81896d5c3c4">tempest-AttachVolumeShelveTestJSON-1010055172</nova:project>
Aug 27 05:16:11 user nova-compute[72904]:       </nova:owner>
Aug 27 05:16:11 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:16:11 user nova-compute[72904]:       <nova:ports>
Aug 27 05:16:11 user nova-compute[72904]:         <nova:port uuid="a31f90c2-aff5-4bb0-9c12-89e8ecd30797">
Aug 27 05:16:11 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 05:16:11 user nova-compute[72904]:         </nova:port>
Aug 27 05:16:11 user nova-compute[72904]:       </nova:ports>
Aug 27 05:16:11 user nova-compute[72904]:     </nova:instance>
Aug 27 05:16:11 user nova-compute[72904]:   </metadata>
Aug 27 05:16:11 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:16:11 user nova-compute[72904]:     <system>
Aug 27 05:16:11 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:16:11 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:16:11 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:16:11 user nova-compute[72904]:       <entry name="serial">103ea467-b0be-4221-81d4-ef2bbbfddc88</entry>
Aug 27 05:16:11 user nova-compute[72904]:       <entry name="uuid">103ea467-b0be-4221-81d4-ef2bbbfddc88</entry>
Aug 27 05:16:11 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:16:11 user nova-compute[72904]:     </system>
Aug 27 05:16:11 user nova-compute[72904]:   </sysinfo>
Aug 27 05:16:11 user nova-compute[72904]:   <os>
Aug 27 05:16:11 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:16:11 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:16:11 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:16:11 user nova-compute[72904]:   </os>
Aug 27 05:16:11 user nova-compute[72904]:   <features>
Aug 27 05:16:11 user nova-compute[72904]:     <acpi/>
Aug 27 05:16:11 user nova-compute[72904]:     <apic/>
Aug 27 05:16:11 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:16:11 user nova-compute[72904]:   </features>
Aug 27 05:16:11 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:16:11 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:16:11 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:16:11 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:16:11 user nova-compute[72904]:   </clock>
Aug 27 05:16:11 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:16:11 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:16:11 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:16:11 user nova-compute[72904]:   </cpu>
Aug 27 05:16:11 user nova-compute[72904]:   <devices>
Aug 27 05:16:11 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:16:11 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:16:11 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk"/>
Aug 27 05:16:11 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:16:11 user nova-compute[72904]:     </disk>
Aug 27 05:16:11 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:16:11 user nova-compute[72904]:       <mac address="fa:16:3e:b6:fe:dc"/>
Aug 27 05:16:11 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:16:11 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:16:11 user nova-compute[72904]:       <target dev="tapa31f90c2-af"/>
Aug 27 05:16:11 user nova-compute[72904]:     </interface>
Aug 27 05:16:11 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:16:11 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/console.log" append="off"/>
Aug 27 05:16:11 user nova-compute[72904]:     </serial>
Aug 27 05:16:11 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:16:11 user nova-compute[72904]:     <video>
Aug 27 05:16:11 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:16:11 user nova-compute[72904]:     </video>
Aug 27 05:16:11 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:16:11 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:16:11 user nova-compute[72904]:     </rng>
Aug 27 05:16:11 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:16:11 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:16:11 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:16:11 user nova-compute[72904]:     </memballoon>
Aug 27 05:16:11 user nova-compute[72904]:   </devices>
Aug 27 05:16:11 user nova-compute[72904]: </domain>
Aug 27 05:16:11 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1446970509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1446970509',id=32,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiQrgc7A7FjqhVOjH4sy6MrmRYpNDFLhOIbKzqYBivxl7GfmXPfG/csWNrDOmp9PJob43UD+0UUaeVIkzTitEjgvxsrO8vRi0Dt1cbc5yB/9L4HLwYYIqo/agkI6byQoQ==',key_name='tempest-keypair-989204785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-ib4vtnbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=103ea467-b0be-4221-81d4-ef2bbbfddc88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG os_vif [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa31f90c2-af, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa31f90c2-af, col_values=(('external_ids', {'iface-id': 'a31f90c2-aff5-4bb0-9c12-89e8ecd30797', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:fe:dc', 'vm-uuid': '103ea467-b0be-4221-81d4-ef2bbbfddc88'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:11 user nova-compute[72904]: INFO os_vif [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af')
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No VIF found with MAC fa:16:3e:b6:fe:dc, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updated VIF entry in instance network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b45bf5b9-1be1-46e2-be98-a1483068c88d req-6a5f8b7f-2911-4d13-a624-53ccd3fe82bc service nova] Releasing lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:16:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-b252f55b-dc15-4107-8eda-a0f8c22e8dfe req-0200bf4b-2ad6-4c2d-a361-e005e6a1fc73 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b252f55b-dc15-4107-8eda-a0f8c22e8dfe req-0200bf4b-2ad6-4c2d-a361-e005e6a1fc73 service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b252f55b-dc15-4107-8eda-a0f8c22e8dfe req-0200bf4b-2ad6-4c2d-a361-e005e6a1fc73 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b252f55b-dc15-4107-8eda-a0f8c22e8dfe req-0200bf4b-2ad6-4c2d-a361-e005e6a1fc73 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-b252f55b-dc15-4107-8eda-a0f8c22e8dfe req-0200bf4b-2ad6-4c2d-a361-e005e6a1fc73 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:16:13 user nova-compute[72904]: WARNING nova.compute.manager [req-b252f55b-dc15-4107-8eda-a0f8c22e8dfe req-0200bf4b-2ad6-4c2d-a361-e005e6a1fc73 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received unexpected event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with vm_state building and task_state spawning.
Aug 27 05:16:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:13 user nova-compute[72904]: INFO nova.compute.manager [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Terminating instance
Aug 27 05:16:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-ce601135-0526-4bdf-8cc0-496af7fb39d1 req-5daa9e88-9e8c-4996-b22e-eba8c2e622a2 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-unplugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ce601135-0526-4bdf-8cc0-496af7fb39d1 req-5daa9e88-9e8c-4996-b22e-eba8c2e622a2 service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ce601135-0526-4bdf-8cc0-496af7fb39d1 req-5daa9e88-9e8c-4996-b22e-eba8c2e622a2 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ce601135-0526-4bdf-8cc0-496af7fb39d1 req-5daa9e88-9e8c-4996-b22e-eba8c2e622a2 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-ce601135-0526-4bdf-8cc0-496af7fb39d1 req-5daa9e88-9e8c-4996-b22e-eba8c2e622a2 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-unplugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-ce601135-0526-4bdf-8cc0-496af7fb39d1 req-5daa9e88-9e8c-4996-b22e-eba8c2e622a2 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-unplugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Instance destroyed successfully.
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'resources' on Instance uuid e8403a20-3d6b-4897-b697-fdb1e7722e4f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:10:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1345860853',display_name='tempest-ServerActionsTestOtherA-server-519660922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1345860853',id=25,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++BiDN+mUiQdqNo4heN++I25Vk6uDCgkOxauU/iskeWbKK2dvwTPa++12IJ1pqvVfHSF/xobaW93KJ6Uqd5KTLkpkHWhOW9ylpRKGUXozXUiC4bSWMwZQerq2l/iY7og==',key_name='tempest-keypair-1714509772',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-mk08pdxu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=e8403a20-3d6b-4897-b697-fdb1e7722e4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "address": "fa:16:3e:af:c5:7b", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22f4c3df-63", "ovs_interfaceid": "22f4c3df-638a-45cd-8f21-adfe33f65c1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG os_vif [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22f4c3df-63, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:16:14 user nova-compute[72904]: INFO os_vif [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:c5:7b,bridge_name='br-int',has_traffic_filtering=True,id=22f4c3df-638a-45cd-8f21-adfe33f65c1a,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22f4c3df-63')
Aug 27 05:16:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Deleting instance files /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f_del
Aug 27 05:16:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Deletion of /opt/stack/data/nova/instances/e8403a20-3d6b-4897-b697-fdb1e7722e4f_del complete
Aug 27 05:16:14 user nova-compute[72904]: INFO nova.compute.manager [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 05:16:14 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113374.9607263, 103ea467-b0be-4221-81d4-ef2bbbfddc88 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:16:14 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] VM Resumed (Lifecycle Event)
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:16:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance spawned successfully.
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113374.9639535, 103ea467-b0be-4221-81d4-ef2bbbfddc88 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:16:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] VM Started (Lifecycle Event)
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:16:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:16:15 user nova-compute[72904]: INFO nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-ff098c8a-0ed7-40aa-baed-b631ed4ac86f req-18bb7316-d9ca-40bd-8d12-cc79e0ea7f27 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ff098c8a-0ed7-40aa-baed-b631ed4ac86f req-18bb7316-d9ca-40bd-8d12-cc79e0ea7f27 service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ff098c8a-0ed7-40aa-baed-b631ed4ac86f req-18bb7316-d9ca-40bd-8d12-cc79e0ea7f27 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ff098c8a-0ed7-40aa-baed-b631ed4ac86f req-18bb7316-d9ca-40bd-8d12-cc79e0ea7f27 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-ff098c8a-0ed7-40aa-baed-b631ed4ac86f req-18bb7316-d9ca-40bd-8d12-cc79e0ea7f27 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:16:15 user nova-compute[72904]: WARNING nova.compute.manager [req-ff098c8a-0ed7-40aa-baed-b631ed4ac86f req-18bb7316-d9ca-40bd-8d12-cc79e0ea7f27 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received unexpected event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with vm_state building and task_state spawning.
Aug 27 05:16:15 user nova-compute[72904]: INFO nova.compute.manager [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Took 6.32 seconds to build instance.
Aug 27 05:16:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39dca7fc-3289-4ff1-8895-8d0feb228bbf tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.420s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:15 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Took 0.82 seconds to deallocate network for instance.
Aug 27 05:16:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:16:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:15 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Deleted allocations for instance e8403a20-3d6b-4897-b697-fdb1e7722e4f
Aug 27 05:16:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f4da6833-04d1-4234-ae94-960b903ae6ea tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.245s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-9e775d79-518a-4671-bc2c-11b5b127e841 req-458be795-ed79-4021-951a-bab6f101fab6 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9e775d79-518a-4671-bc2c-11b5b127e841 req-458be795-ed79-4021-951a-bab6f101fab6 service nova] Acquiring lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9e775d79-518a-4671-bc2c-11b5b127e841 req-458be795-ed79-4021-951a-bab6f101fab6 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9e775d79-518a-4671-bc2c-11b5b127e841 req-458be795-ed79-4021-951a-bab6f101fab6 service nova] Lock "e8403a20-3d6b-4897-b697-fdb1e7722e4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-9e775d79-518a-4671-bc2c-11b5b127e841 req-458be795-ed79-4021-951a-bab6f101fab6 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] No waiting events found dispatching network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:16:16 user nova-compute[72904]: WARNING nova.compute.manager [req-9e775d79-518a-4671-bc2c-11b5b127e841 req-458be795-ed79-4021-951a-bab6f101fab6 service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received unexpected event network-vif-plugged-22f4c3df-638a-45cd-8f21-adfe33f65c1a for instance with vm_state deleted and task_state None.
Aug 27 05:16:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-1be1bcff-c03e-456a-a42c-1c890054c241 req-092a333b-b737-4de9-8831-e6e52aef981f service nova] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Received event network-vif-deleted-22f4c3df-638a-45cd-8f21-adfe33f65c1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:16:22 user nova-compute[72904]: INFO nova.compute.claims [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Claim successful on node user
Aug 27 05:16:22 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:16:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:16:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG nova.policy [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc32ad60b20c47f6a7790a8d28bb03dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9850ebbdbc8d4081ba11931417e4d96b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:16:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Creating image(s)
Aug 27 05:16:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "/opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "/opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "0d1469654f05bf3410ad9defcf8f8a92aecabb3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "0d1469654f05bf3410ad9defcf8f8a92aecabb3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Successfully created port: b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.part --force-share --output=json" returned: 0 in 0.222s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG nova.virt.images [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] 48268df4-52b1-4c94-b143-234da60dc060 was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.part /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.part /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.converted" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "0d1469654f05bf3410ad9defcf8f8a92aecabb3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.106s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "0d1469654f05bf3410ad9defcf8f8a92aecabb3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "0d1469654f05bf3410ad9defcf8f8a92aecabb3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG nova.network.neutron [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Successfully updated port: b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing instance network info cache due to event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] Acquiring lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] Acquired lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG nova.network.neutron [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG nova.network.neutron [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b,backing_fmt=raw /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b,backing_fmt=raw /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk 1073741824" returned: 0 in 0.051s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "0d1469654f05bf3410ad9defcf8f8a92aecabb3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-57571564-1e31-457e-9a84-c845cf524f19 req-d2451781-545e-4858-a0c8-e1f77becfb63 service nova] Releasing lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquired lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Cannot resize image /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Ensure instance console log exists: /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Releasing lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance network_info: |[{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Start _get_guest_xml network_info=[{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T05:16:19Z,direct_url=<?>,disk_format='qcow2',id=48268df4-52b1-4c94-b143-234da60dc060,min_disk=0,min_ram=0,name='tempest-scenario-img--2115080284',owner='9850ebbdbc8d4081ba11931417e4d96b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T05:16:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '48268df4-52b1-4c94-b143-234da60dc060'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:16:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:16:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T05:16:19Z,direct_url=<?>,disk_format='qcow2',id=48268df4-52b1-4c94-b143-234da60dc060,min_disk=0,min_ram=0,name='tempest-scenario-img--2115080284',owner='9850ebbdbc8d4081ba11931417e4d96b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T05:16:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121354445',display_name='tempest-TestMinimumBasicScenario-server-2121354445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121354445',id=33,image_ref='48268df4-52b1-4c94-b143-234da60dc060',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2vne0q2ZUC4Q2bsG3O4fxg4jfOMXN4zLMMmT4e6uRA2Gh/kSWl4tpDxR1FgiHNxtLkzM8NCxrU80VMmjAvd+6GbGV8H1l81/uKdUbFff/Jv52ZU8oe5NKk8OhnwBLZYA==',key_name='tempest-TestMinimumBasicScenario-830296001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-2yfj11rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='48268df4-52b1-4c94-b143-234da60dc060',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:16:23Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=7fe87c87-d6bf-4cee-a0f3-67b563122d18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e7:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9a3f7fc-8a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fe87c87-d6bf-4cee-a0f3-67b563122d18 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:16:25 user nova-compute[72904]:   <uuid>7fe87c87-d6bf-4cee-a0f3-67b563122d18</uuid>
Aug 27 05:16:25 user nova-compute[72904]:   <name>instance-00000021</name>
Aug 27 05:16:25 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:16:25 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:16:25 user nova-compute[72904]:   <metadata>
Aug 27 05:16:25 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:16:25 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:16:25 user nova-compute[72904]:       <nova:name>tempest-TestMinimumBasicScenario-server-2121354445</nova:name>
Aug 27 05:16:25 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:16:25</nova:creationTime>
Aug 27 05:16:25 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:16:25 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:16:25 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:16:25 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:16:25 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:16:25 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:16:25 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:16:25 user nova-compute[72904]:       <nova:owner>
Aug 27 05:16:25 user nova-compute[72904]:         <nova:user uuid="bc32ad60b20c47f6a7790a8d28bb03dc">tempest-TestMinimumBasicScenario-216754606-project-member</nova:user>
Aug 27 05:16:25 user nova-compute[72904]:         <nova:project uuid="9850ebbdbc8d4081ba11931417e4d96b">tempest-TestMinimumBasicScenario-216754606</nova:project>
Aug 27 05:16:25 user nova-compute[72904]:       </nova:owner>
Aug 27 05:16:25 user nova-compute[72904]:       <nova:root type="image" uuid="48268df4-52b1-4c94-b143-234da60dc060"/>
Aug 27 05:16:25 user nova-compute[72904]:       <nova:ports>
Aug 27 05:16:25 user nova-compute[72904]:         <nova:port uuid="b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7">
Aug 27 05:16:25 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 27 05:16:25 user nova-compute[72904]:         </nova:port>
Aug 27 05:16:25 user nova-compute[72904]:       </nova:ports>
Aug 27 05:16:25 user nova-compute[72904]:     </nova:instance>
Aug 27 05:16:25 user nova-compute[72904]:   </metadata>
Aug 27 05:16:25 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:16:25 user nova-compute[72904]:     <system>
Aug 27 05:16:25 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:16:25 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:16:25 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:16:25 user nova-compute[72904]:       <entry name="serial">7fe87c87-d6bf-4cee-a0f3-67b563122d18</entry>
Aug 27 05:16:25 user nova-compute[72904]:       <entry name="uuid">7fe87c87-d6bf-4cee-a0f3-67b563122d18</entry>
Aug 27 05:16:25 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:16:25 user nova-compute[72904]:     </system>
Aug 27 05:16:25 user nova-compute[72904]:   </sysinfo>
Aug 27 05:16:25 user nova-compute[72904]:   <os>
Aug 27 05:16:25 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:16:25 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:16:25 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:16:25 user nova-compute[72904]:   </os>
Aug 27 05:16:25 user nova-compute[72904]:   <features>
Aug 27 05:16:25 user nova-compute[72904]:     <acpi/>
Aug 27 05:16:25 user nova-compute[72904]:     <apic/>
Aug 27 05:16:25 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:16:25 user nova-compute[72904]:   </features>
Aug 27 05:16:25 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:16:25 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:16:25 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:16:25 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:16:25 user nova-compute[72904]:   </clock>
Aug 27 05:16:25 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:16:25 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:16:25 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:16:25 user nova-compute[72904]:   </cpu>
Aug 27 05:16:25 user nova-compute[72904]:   <devices>
Aug 27 05:16:25 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:16:25 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:16:25 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk"/>
Aug 27 05:16:25 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:16:25 user nova-compute[72904]:     </disk>
Aug 27 05:16:25 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:16:25 user nova-compute[72904]:       <mac address="fa:16:3e:e6:e7:f2"/>
Aug 27 05:16:25 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:16:25 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:16:25 user nova-compute[72904]:       <target dev="tapb9a3f7fc-8a"/>
Aug 27 05:16:25 user nova-compute[72904]:     </interface>
Aug 27 05:16:25 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:16:25 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/console.log" append="off"/>
Aug 27 05:16:25 user nova-compute[72904]:     </serial>
Aug 27 05:16:25 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:16:25 user nova-compute[72904]:     <video>
Aug 27 05:16:25 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:16:25 user nova-compute[72904]:     </video>
Aug 27 05:16:25 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:16:25 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:16:25 user nova-compute[72904]:     </rng>
Aug 27 05:16:25 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:16:25 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:16:25 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:16:25 user nova-compute[72904]:     </memballoon>
Aug 27 05:16:25 user nova-compute[72904]:   </devices>
Aug 27 05:16:25 user nova-compute[72904]: </domain>
Aug 27 05:16:25 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121354445',display_name='tempest-TestMinimumBasicScenario-server-2121354445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121354445',id=33,image_ref='48268df4-52b1-4c94-b143-234da60dc060',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2vne0q2ZUC4Q2bsG3O4fxg4jfOMXN4zLMMmT4e6uRA2Gh/kSWl4tpDxR1FgiHNxtLkzM8NCxrU80VMmjAvd+6GbGV8H1l81/uKdUbFff/Jv52ZU8oe5NKk8OhnwBLZYA==',key_name='tempest-TestMinimumBasicScenario-830296001',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-2yfj11rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='48268df4-52b1-4c94-b143-234da60dc060',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:16:23Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=7fe87c87-d6bf-4cee-a0f3-67b563122d18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e7:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9a3f7fc-8a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG os_vif [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e7:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9a3f7fc-8a') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9a3f7fc-8a, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9a3f7fc-8a, col_values=(('external_ids', {'iface-id': 'b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:e7:f2', 'vm-uuid': '7fe87c87-d6bf-4cee-a0f3-67b563122d18'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:25 user nova-compute[72904]: INFO os_vif [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:e7:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9a3f7fc-8a')
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:16:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No VIF found with MAC fa:16:3e:e6:e7:f2, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:16:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-70992524-25b0-4cb4-8791-9cb8fa45fcfb req-75294c2b-adf5-4935-8fc8-091dee38ae09 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-70992524-25b0-4cb4-8791-9cb8fa45fcfb req-75294c2b-adf5-4935-8fc8-091dee38ae09 service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-70992524-25b0-4cb4-8791-9cb8fa45fcfb req-75294c2b-adf5-4935-8fc8-091dee38ae09 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-70992524-25b0-4cb4-8791-9cb8fa45fcfb req-75294c2b-adf5-4935-8fc8-091dee38ae09 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-70992524-25b0-4cb4-8791-9cb8fa45fcfb req-75294c2b-adf5-4935-8fc8-091dee38ae09 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:16:27 user nova-compute[72904]: WARNING nova.compute.manager [req-70992524-25b0-4cb4-8791-9cb8fa45fcfb req-75294c2b-adf5-4935-8fc8-091dee38ae09 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received unexpected event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with vm_state building and task_state spawning.
Aug 27 05:16:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-912d3a31-6c77-4761-ae3d-8600351472ab req-1a44f311-75e4-4dd4-bc71-b59fabed5781 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-912d3a31-6c77-4761-ae3d-8600351472ab req-1a44f311-75e4-4dd4-bc71-b59fabed5781 service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-912d3a31-6c77-4761-ae3d-8600351472ab req-1a44f311-75e4-4dd4-bc71-b59fabed5781 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-912d3a31-6c77-4761-ae3d-8600351472ab req-1a44f311-75e4-4dd4-bc71-b59fabed5781 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-912d3a31-6c77-4761-ae3d-8600351472ab req-1a44f311-75e4-4dd4-bc71-b59fabed5781 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:16:29 user nova-compute[72904]: WARNING nova.compute.manager [req-912d3a31-6c77-4761-ae3d-8600351472ab req-1a44f311-75e4-4dd4-bc71-b59fabed5781 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received unexpected event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with vm_state building and task_state spawning.
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113389.1564338, 7fe87c87-d6bf-4cee-a0f3-67b563122d18 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] VM Resumed (Lifecycle Event)
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance spawned successfully.
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113389.1598997, 7fe87c87-d6bf-4cee-a0f3-67b563122d18 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] VM Started (Lifecycle Event)
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Took 5.93 seconds to spawn the instance on the hypervisor.
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.compute.manager [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Took 6.98 seconds to build instance.
Aug 27 05:16:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb6bf16e-35e8-4d7b-9f13-891a35439d24 tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.090s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113374.5435455, e8403a20-3d6b-4897-b697-fdb1e7722e4f => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:16:29 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] VM Stopped (Lifecycle Event)
Aug 27 05:16:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-722ed9df-03c9-429f-80a3-ab3d361a1617 None None] [instance: e8403a20-3d6b-4897-b697-fdb1e7722e4f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:16:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:30 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:30 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:16:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:16:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:16:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=25.112770080566406GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance be32e4e5-ed6d-4569-88a2-8fb43041e51e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 103ea467-b0be-4221-81d4-ef2bbbfddc88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-changed-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Refreshing instance network info cache due to event network-changed-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] Acquiring lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] Acquired lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Refreshing network info cache for port 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:16:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG nova.objects.instance [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'flavor' on Instance uuid be32e4e5-ed6d-4569-88a2-8fb43041e51e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:37 user nova-compute[72904]: INFO nova.compute.manager [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Attaching volume bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 to /dev/vdb
Aug 27 05:16:37 user nova-compute[72904]: DEBUG os_brick.utils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[227a4067-ed8c-4653-9a65-a8836e7f7548]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0aa87e-fc0b-4e4d-9932-40cf0be51c39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9066d8-0d72-4ca5-924b-0163883160d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f4bb41-df67-41fe-a716-9ce7de382052]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:16:37 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[191ac620-c05c-471b-83be-c7328bfacace]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG os_brick.utils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updating existing volume attachment record: dc79edab-fcf0-4c09-9bc2-6d079e9d911e {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updated VIF entry in instance network info cache for port 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG nova.network.neutron [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updating instance_info_cache with network_info: [{"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-90d3bf78-6af4-4514-8869-17f0bdd921e1 req-a50e946e-8ddd-4e35-a234-9bd93f3aa1f5 service nova] Releasing lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:16:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:16:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-changed-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:16:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Refreshing instance network info cache due to event network-changed-b64e969b-aacc-4d31-8acf-46ad4e0fa40e. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:16:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] Acquiring lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:16:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] Acquired lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:16:41 user nova-compute[72904]: DEBUG nova.network.neutron [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Refreshing network info cache for port b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:16:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:42 user nova-compute[72904]: DEBUG nova.network.neutron [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updated VIF entry in instance network info cache for port b64e969b-aacc-4d31-8acf-46ad4e0fa40e. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:16:42 user nova-compute[72904]: DEBUG nova.network.neutron [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updating instance_info_cache with network_info: [{"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:16:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3ee56892-af4a-4c6e-bf6a-a02a6d00425b req-1be2e5d8-7908-4af9-b001-cc78bdf207a9 service nova] Releasing lock "refresh_cache-52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:16:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG nova.objects.instance [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:46 user nova-compute[72904]: INFO nova.compute.manager [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Attaching volume f155f32c-86d9-408f-891b-8dee6d6947da to /dev/vdb
Aug 27 05:16:46 user nova-compute[72904]: DEBUG os_brick.utils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[66258fd0-ef07-4e90-93ca-b85565a228e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e183d2-0b0e-4edc-8e47-bad601d1c412]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded43cd3-06a9-4f80-9346-9c78c6456607]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442000d-14cd-47c9-995a-0590104c839c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:16:46 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:16:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6adf2b-634d-4198-ab79-5f470344d170]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG os_brick.utils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:16:46 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updating existing volume attachment record: 6fb654d7-58f6-48e7-8fc2-52d3d33623f6 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuqAZbRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:16:49 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:16:49 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:16:49 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efe2ff6-768d-4105-b2c7-09e88f979eb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:16:49 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d105aca-97bf-42f1-a6ae-09f9a7233a21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3] added
Aug 27 05:16:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea03d18a-b9c9-4053-9ba0-3ab25921434b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[75708069-fefd-4809-be74-1f6c95ddbc1f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuqAZbRv {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuqAZbRv" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac59a6a6-ccc8-474e-832d-f8f8bd802cc7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SuqAZbRv'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6257767f-9340-4faf-bdd4-548bbbc404eb]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d186c9e9-288a-4ff2-93f2-5ab518cd933f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:16:49 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:16:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:16:49 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:16:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[18764cfb-b2bc-4c80-bd0f-5d5fb7cc6fdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260]
Aug 27 05:16:49 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260] successful.
Aug 27 05:16:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22f4e74-c6f7-4e3e-982d-698b99f76406]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a0885-1f00-4908-a6c3-79265677fe7b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:16:49 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:16:49 user nova-compute[72904]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 (non-flash)
Aug 27 05:16:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:16:49 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:16:49 user nova-compute[72904]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 (non-flash)
Aug 27 05:16:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6d1129-bbc7-444d-9454-ac68e686348b]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:16:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuqAZbRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:16:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:16:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23135333035343161', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:16:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135333035343161', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:16:50 user nova-compute[72904]: DEBUG nova.objects.instance [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'flavor' on Instance uuid be32e4e5-ed6d-4569-88a2-8fb43041e51e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:16:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:16:50 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:16:50 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:16:50 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:16:50 user nova-compute[72904]:   <serial>bd8ef2ef-6b82-4f5a-8058-c896366f5ad3</serial>
Aug 27 05:16:50 user nova-compute[72904]: </disk>
Aug 27 05:16:50 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:16:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:16:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:16:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] No VIF found with MAC fa:16:3e:77:1f:38, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:16:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fb5eee38-c670-439f-b1f3-1466064f6574 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.868s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:16:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:16:52 user nova-compute[72904]: INFO nova.compute.manager [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Detaching volume bd8ef2ef-6b82-4f5a-8058-c896366f5ad3
Aug 27 05:16:52 user nova-compute[72904]: INFO nova.virt.block_device [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Attempting to driver detach volume bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 from mountpoint /dev/vdb
Aug 27 05:16:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Attempting to detach device vdb from instance be32e4e5-ed6d-4569-88a2-8fb43041e51e from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:16:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:16:52 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:16:52 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:16:52 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:16:52 user nova-compute[72904]:   <serial>bd8ef2ef-6b82-4f5a-8058-c896366f5ad3</serial>
Aug 27 05:16:52 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:16:52 user nova-compute[72904]: </disk>
Aug 27 05:16:52 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:16:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully detached device vdb from instance be32e4e5-ed6d-4569-88a2-8fb43041e51e from the persistent domain config.
Aug 27 05:16:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be32e4e5-ed6d-4569-88a2-8fb43041e51e from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:16:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:16:52 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:16:52 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:16:52 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:16:52 user nova-compute[72904]:   <serial>bd8ef2ef-6b82-4f5a-8058-c896366f5ad3</serial>
Aug 27 05:16:52 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:16:52 user nova-compute[72904]: </disk>
Aug 27 05:16:52 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:16:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113412.989188, be32e4e5-ed6d-4569-88a2-8fb43041e51e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:16:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be32e4e5-ed6d-4569-88a2-8fb43041e51e {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:16:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully detached device vdb from instance be32e4e5-ed6d-4569-88a2-8fb43041e51e from the live domain config.
Aug 27 05:16:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuqAZbRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:16:53 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca48716-a228-4c8a-81cc-843eae77932b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa52da-2271-4e8a-bb91-068ed1a3f372]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:16:53 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:16:53 user nova-compute[72904]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 (non-flash)
Aug 27 05:16:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:16:53 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:16:53 user nova-compute[72904]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 (non-flash)
Aug 27 05:16:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91941d4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2626f002-430f-4748-840c-b87bd6478fb3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb28dac-6469-4d0c-94fe-972940334b09]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[955ca795-78b5-4cc0-9dda-cfb75b4fc708]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e599c3-7433-4e45-8482-3302185b42c7]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[585faddd-ee2c-4ea0-a21a-baf2f90ee19d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5694631a-0a7a-49a4-abac-dacfc571c60e]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260]
Aug 27 05:16:53 user nova-compute[72904]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3, portal: 172.16.0.220,3260] successful.
Aug 27 05:16:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd8ef2ef-6b82-4f5a-8058-c896366f5ad3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4288590f-d737-4f36-b176-5d29b7203afd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] <== disconnect_volume: return (276ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:16:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:16:54 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'flavor' on Instance uuid be32e4e5-ed6d-4569-88a2-8fb43041e51e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:16:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2c8021af-1a54-4446-8d03-e6ccae2612a3 tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:16:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:16:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "63df90c8-8277-4fae-8fd0-37d748101579" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:17:08 user nova-compute[72904]: INFO nova.compute.claims [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Claim successful on node user
Aug 27 05:17:08 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:17:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:17:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:17:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:17:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:17:09 user nova-compute[72904]: INFO nova.virt.block_device [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Booting with volume-backed-image 946923b5-2c8b-4abd-9b8c-c0df6f5e9219 at /dev/vda
Aug 27 05:17:09 user nova-compute[72904]: DEBUG nova.policy [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4bbded3a71e4d6196d83c1fa5e7a868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da9ae29302d54f8aa82e6c51bbfba65d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:17:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Successfully created port: 2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Successfully updated port: 2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-changed-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Refreshing instance network info cache due to event network-changed-2ca4ef45-c505-4a43-b318-6ddd3518593f. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] Acquiring lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:17:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updating instance_info_cache with network_info: [{"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance network_info: |[{"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] Acquired lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Refreshing network info cache for port 2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updated VIF entry in instance network info cache for port 2ca4ef45-c505-4a43-b318-6ddd3518593f. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updating instance_info_cache with network_info: [{"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d0d693f0-8468-4ac6-abaa-02e9de76f8fe req-0e76c267-9852-4055-99de-11a9ebd85b85 service nova] Releasing lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdmLOBXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:17:11 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:11 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:11 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e1fce3-4e5b-49e2-a85a-1088eb47d1eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:17:11 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d06aa00-c431-40c0-a316-48a5764d67e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da] added
Aug 27 05:17:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[33544e99-fb24-4339-819c-8ef4de3d9414]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d31197-118a-4d55-aef7-3b42db2f95d4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdmLOBXI {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CdmLOBXI" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8855194-7eca-4927-a1f4-f1fc326c70d5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CdmLOBXI'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6931d717-9736-4b59-9eac-4e943cfc13da]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf0e3f-3c2f-4528-99c1-d23c7f17d5b7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:11 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:11 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b73cbce-bf06-40e0-8338-642d8ca45c74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260]
Aug 27 05:17:11 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260] successful.
Aug 27 05:17:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[be079565-ed8b-402a-aba1-b0327dc86fa8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb2c13e-7e03-4b02-b3fa-07567429f035]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:11 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:11 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:11 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:11 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:11 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f5f8b1-e275-4bb1-876e-e811da30ea08]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:17:12 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:17:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdmLOBXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:17:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26364386337616164', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:17:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364386337616164', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:17:12 user nova-compute[72904]: DEBUG nova.objects.instance [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:17:12 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:17:12 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:17:12 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:17:12 user nova-compute[72904]:   <serial>f155f32c-86d9-408f-891b-8dee6d6947da</serial>
Aug 27 05:17:12 user nova-compute[72904]: </disk>
Aug 27 05:17:12 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:17:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:17:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:17:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No VIF found with MAC fa:16:3e:cc:a1:2a, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:17:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-39655433-e967-4491-9e57-d3a94c26b352 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.663s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:19 user nova-compute[72904]: INFO nova.compute.manager [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Attaching volume 9f5641eb-37fe-490e-a59c-ef742a20a773 to /dev/vdc
Aug 27 05:17:19 user nova-compute[72904]: DEBUG os_brick.utils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b25e9db-35cf-4cef-b194-6a4c8040b257]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6268a66a-5c68-4a6a-8d22-c3cc29c2d5da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1322ca9-5f36-4a22-a2d7-8a391d399ac8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7280a118-c63f-4092-81ca-1d4f00aa6d5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:17:19 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:17:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[948ffdf0-cd02-4438-adc4-30894656f845]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG os_brick.utils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:17:19 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updating existing volume attachment record: 6ee4d78a-c96d-459e-99f1-440f2b4dda14 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG os_brick.utils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f4146-ee70-4379-8e2b-06ee65403aa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f026f9e8-b73b-4dba-8694-968ca2e6089b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5693ca26-9fbd-4c25-bebd-460d1d6d6de0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbac19a-f004-4244-897f-87f56623c07f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:17:20 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:17:20 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b858645-535c-46a4-a435-653a933f85b3]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG os_brick.utils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updating existing volume attachment record: 9f8c086d-be10-4093-8a04-e58a40ef4ccc {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:17:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'giTyDASH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:17:32 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:32 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:32 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[444f89a3-2c7d-4981-8a59-28c65bcbde40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:17:32 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66a1ec9-edeb-44c3-8526-fb6ba18ab7cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773] added
Aug 27 05:17:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8089daf6-a7c5-4c08-a892-69178e70ef38]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[428f14ec-e116-4e83-8212-9c65de518e36]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v giTyDASH {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v giTyDASH" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c928ab1f-f635-45c5-8a90-de50920c1d3a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'giTyDASH'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b76b0-bb17-4e20-a88b-071ce9b44867]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef4ddb4-30c1-4e30-b309-6fc97e2ea277]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d2396d-7adf-4600-93d8-e62284fee89a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260]
Aug 27 05:17:32 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260] successful.
Aug 27 05:17:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49538fe-55e8-46f1-a8fd-d9e19730f89f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85d7396-4a73-4267-9e96-b1a209711d35]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:32 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd4f367-5156-454e-adc8-0506979b7c98]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:17:33 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Creating image(s)
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Ensure instance console log exists: /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Start _get_guest_xml network_info=[{"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9f8c086d-be10-4093-8a04-e58a40ef4ccc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tExwZPHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '63df90c8-8277-4fae-8fd0-37d748101579', 'attached_at': '', 'detached_at': '', 'volume_id': 'd22c3bb2-4feb-42f0-ad6b-3b0fdff93b28', 'serial': 'd22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:17:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:17:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tExwZPHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:17:33 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'giTyDASH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23837343730653636', 'path': '/dev/sde'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837343730653636', 'path': '/dev/sde'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.633s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:33 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:33 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.objects.instance [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb77e9e-ea93-4c7f-8458-db68eab09685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:17:33 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fb667-aded-423b-9168-9180922d0061]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28] added
Aug 27 05:17:33 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:17:33 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:17:33 user nova-compute[72904]:   <source dev="/dev/sde"/>
Aug 27 05:17:33 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:17:33 user nova-compute[72904]:   <serial>9f5641eb-37fe-490e-a59c-ef742a20a773</serial>
Aug 27 05:17:33 user nova-compute[72904]: </disk>
Aug 27 05:17:33 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b478d68-fbeb-4c60-9afb-fe1c43c55b18]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4265ce-589b-4c87-a9db-0373cd5dd63c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tExwZPHg {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tExwZPHg" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8490a6-f73e-4cce-9ed9-28035b56de85]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tExwZPHg'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[141839f1-7561-451b-b169-e5f5440ef94b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90bfff9-ca8d-4025-a565-57aa760c4567]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:33 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:33 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:33 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:33 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:33 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:33 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:33 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:33 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d662e4da-353b-483c-8ecf-90dc9cae04a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260]
Aug 27 05:17:34 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260] successful.
Aug 27 05:17:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11474d7-0c96-45f6-b547-9c5b259905b0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a09e45-1122-4916-8ebf-b3294d379d0c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:17:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:34 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:17:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8314f40-6573-41e7-9b03-05a38e60c631]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tExwZPHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] No VIF found with MAC fa:16:3e:cc:a1:2a, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-24333e33-0eed-4c7c-aa29-bce398d445c4 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.821s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== connect_volume: return (2026ms) {'type': 'block', 'scsi_wwn': '26138306436616633', 'path': '/dev/sdf'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138306436616633', 'path': '/dev/sdf'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777426695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777426695',id=34,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-f237q405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:17:09Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=63df90c8-8277-4fae-8fd0-37d748101579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'pci_devices' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:35 user nova-compute[72904]: INFO nova.compute.manager [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Detaching volume f155f32c-86d9-408f-891b-8dee6d6947da
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:17:35 user nova-compute[72904]:   <uuid>63df90c8-8277-4fae-8fd0-37d748101579</uuid>
Aug 27 05:17:35 user nova-compute[72904]:   <name>instance-00000022</name>
Aug 27 05:17:35 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:17:35 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:17:35 user nova-compute[72904]:   <metadata>
Aug 27 05:17:35 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:17:35 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:17:35 user nova-compute[72904]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1777426695</nova:name>
Aug 27 05:17:35 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:17:33</nova:creationTime>
Aug 27 05:17:35 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:17:35 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:17:35 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:17:35 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:17:35 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:17:35 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:17:35 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:17:35 user nova-compute[72904]:       <nova:owner>
Aug 27 05:17:35 user nova-compute[72904]:         <nova:user uuid="f4bbded3a71e4d6196d83c1fa5e7a868">tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member</nova:user>
Aug 27 05:17:35 user nova-compute[72904]:         <nova:project uuid="da9ae29302d54f8aa82e6c51bbfba65d">tempest-ServerBootFromVolumeStableRescueTest-1493340065</nova:project>
Aug 27 05:17:35 user nova-compute[72904]:       </nova:owner>
Aug 27 05:17:35 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:17:35 user nova-compute[72904]:       <nova:ports>
Aug 27 05:17:35 user nova-compute[72904]:         <nova:port uuid="2ca4ef45-c505-4a43-b318-6ddd3518593f">
Aug 27 05:17:35 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:17:35 user nova-compute[72904]:         </nova:port>
Aug 27 05:17:35 user nova-compute[72904]:       </nova:ports>
Aug 27 05:17:35 user nova-compute[72904]:     </nova:instance>
Aug 27 05:17:35 user nova-compute[72904]:   </metadata>
Aug 27 05:17:35 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:17:35 user nova-compute[72904]:     <system>
Aug 27 05:17:35 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:17:35 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:17:35 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:17:35 user nova-compute[72904]:       <entry name="serial">63df90c8-8277-4fae-8fd0-37d748101579</entry>
Aug 27 05:17:35 user nova-compute[72904]:       <entry name="uuid">63df90c8-8277-4fae-8fd0-37d748101579</entry>
Aug 27 05:17:35 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:17:35 user nova-compute[72904]:     </system>
Aug 27 05:17:35 user nova-compute[72904]:   </sysinfo>
Aug 27 05:17:35 user nova-compute[72904]:   <os>
Aug 27 05:17:35 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:17:35 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:17:35 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:17:35 user nova-compute[72904]:   </os>
Aug 27 05:17:35 user nova-compute[72904]:   <features>
Aug 27 05:17:35 user nova-compute[72904]:     <acpi/>
Aug 27 05:17:35 user nova-compute[72904]:     <apic/>
Aug 27 05:17:35 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:17:35 user nova-compute[72904]:   </features>
Aug 27 05:17:35 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:17:35 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:17:35 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:17:35 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:17:35 user nova-compute[72904]:   </clock>
Aug 27 05:17:35 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:17:35 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:17:35 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:17:35 user nova-compute[72904]:   </cpu>
Aug 27 05:17:35 user nova-compute[72904]:   <devices>
Aug 27 05:17:35 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:17:35 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:17:35 user nova-compute[72904]:       <source dev="/dev/sdf"/>
Aug 27 05:17:35 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:17:35 user nova-compute[72904]:       <serial>d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28</serial>
Aug 27 05:17:35 user nova-compute[72904]:     </disk>
Aug 27 05:17:35 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:17:35 user nova-compute[72904]:       <mac address="fa:16:3e:06:f1:54"/>
Aug 27 05:17:35 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:17:35 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:17:35 user nova-compute[72904]:       <target dev="tap2ca4ef45-c5"/>
Aug 27 05:17:35 user nova-compute[72904]:     </interface>
Aug 27 05:17:35 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:17:35 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/console.log" append="off"/>
Aug 27 05:17:35 user nova-compute[72904]:     </serial>
Aug 27 05:17:35 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:17:35 user nova-compute[72904]:     <video>
Aug 27 05:17:35 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:17:35 user nova-compute[72904]:     </video>
Aug 27 05:17:35 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:17:35 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:17:35 user nova-compute[72904]:     </rng>
Aug 27 05:17:35 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:17:35 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:17:35 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:17:35 user nova-compute[72904]:     </memballoon>
Aug 27 05:17:35 user nova-compute[72904]:   </devices>
Aug 27 05:17:35 user nova-compute[72904]: </domain>
Aug 27 05:17:35 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777426695',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777426695',id=34,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-f237q405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:17:09Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=63df90c8-8277-4fae-8fd0-37d748101579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG os_vif [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ca4ef45-c5, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ca4ef45-c5, col_values=(('external_ids', {'iface-id': '2ca4ef45-c505-4a43-b318-6ddd3518593f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:f1:54', 'vm-uuid': '63df90c8-8277-4fae-8fd0-37d748101579'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:35 user nova-compute[72904]: INFO os_vif [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5')
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:35 user nova-compute[72904]: INFO nova.virt.block_device [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Attempting to driver detach volume f155f32c-86d9-408f-891b-8dee6d6947da from mountpoint /dev/vdb
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Attempting to detach device vdb from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:17:35 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:17:35 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:17:35 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:17:35 user nova-compute[72904]:   <serial>f155f32c-86d9-408f-891b-8dee6d6947da</serial>
Aug 27 05:17:35 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:17:35 user nova-compute[72904]: </disk>
Aug 27 05:17:35 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:17:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully detached device vdb from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the persistent domain config.
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:17:35 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:17:35 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:17:35 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:17:35 user nova-compute[72904]:   <serial>f155f32c-86d9-408f-891b-8dee6d6947da</serial>
Aug 27 05:17:35 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:17:35 user nova-compute[72904]: </disk>
Aug 27 05:17:35 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No VIF found with MAC fa:16:3e:06:f1:54, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113455.945291, 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:17:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully detached device vdb from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the live domain config.
Aug 27 05:17:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CdmLOBXI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:17:35 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5adb46-7291-4538-b3e1-100d7dfd1bf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e20b23-7e21-42fc-8293-53916528153e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:17:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:36 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:17:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7e8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca85f1-3e30-4b4a-a82c-dff183174688]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8274d825-728e-4556-8df8-3fce4d2c60a0]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb6d403-634b-4fd6-86f4-6ee1904e8082]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[065a7162-926e-4b31-81d4-51715c64fca1]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[40608b92-3070-442d-96f5-e76a952b6ece]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1ea004-4d16-45a3-86aa-3217b4c3cfd2]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260]
Aug 27 05:17:36 user nova-compute[72904]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da, portal: 172.16.0.220,3260] successful.
Aug 27 05:17:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f155f32c-86d9-408f-891b-8dee6d6947da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[65563c76-b291-4365-ba38-c667a526b89f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== disconnect_volume: return (355ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.objects.instance [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:17:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7176MB free_disk=25.063495635986328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-645a73de-e7a9-408c-ac14-7768b2df2626 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.236s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance be32e4e5-ed6d-4569-88a2-8fb43041e51e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 103ea467-b0be-4221-81d4-ef2bbbfddc88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 63df90c8-8277-4fae-8fd0-37d748101579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:37 user nova-compute[72904]: INFO nova.compute.manager [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Detaching volume 9f5641eb-37fe-490e-a59c-ef742a20a773
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-22a15238-b3ba-4da2-8a3e-633e6ded5f8f req-b83d9776-a087-4547-9643-6d16c7931a86 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22a15238-b3ba-4da2-8a3e-633e6ded5f8f req-b83d9776-a087-4547-9643-6d16c7931a86 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22a15238-b3ba-4da2-8a3e-633e6ded5f8f req-b83d9776-a087-4547-9643-6d16c7931a86 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-22a15238-b3ba-4da2-8a3e-633e6ded5f8f req-b83d9776-a087-4547-9643-6d16c7931a86 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-22a15238-b3ba-4da2-8a3e-633e6ded5f8f req-b83d9776-a087-4547-9643-6d16c7931a86 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:37 user nova-compute[72904]: WARNING nova.compute.manager [req-22a15238-b3ba-4da2-8a3e-633e6ded5f8f req-b83d9776-a087-4547-9643-6d16c7931a86 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state building and task_state spawning.
Aug 27 05:17:37 user nova-compute[72904]: INFO nova.virt.block_device [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Attempting to driver detach volume 9f5641eb-37fe-490e-a59c-ef742a20a773 from mountpoint /dev/vdc
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Attempting to detach device vdc from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:17:37 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:17:37 user nova-compute[72904]:   <source dev="/dev/sde"/>
Aug 27 05:17:37 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:17:37 user nova-compute[72904]:   <serial>9f5641eb-37fe-490e-a59c-ef742a20a773</serial>
Aug 27 05:17:37 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 05:17:37 user nova-compute[72904]: </disk>
Aug 27 05:17:37 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:17:37 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully detached device vdc from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the persistent domain config.
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:17:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:17:37 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:17:37 user nova-compute[72904]:   <source dev="/dev/sde"/>
Aug 27 05:17:37 user nova-compute[72904]:   <target dev="vdc" bus="virtio"/>
Aug 27 05:17:37 user nova-compute[72904]:   <serial>9f5641eb-37fe-490e-a59c-ef742a20a773</serial>
Aug 27 05:17:37 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 27 05:17:37 user nova-compute[72904]: </disk>
Aug 27 05:17:37 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.883s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113458.3943434, 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:17:38 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully detached device vdc from instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 from the live domain config.
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'giTyDASH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:17:38 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7389b669-21c4-407a-a128-8b19b70c9894]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a15053b-33c8-492e-9fcf-968cffe5796d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:38 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:38 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:38 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:17:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:17:38 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:17:38 user nova-compute[72904]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 (non-flash)
Aug 27 05:17:38 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:17:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194537d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773'): ({'sde'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Removing single pathed devices sde {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f254f6e-de5b-49ae-bb43-4af944809a28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ab24f3-3947-4836-be8c-04d2c28cf6c3]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Flushing IO for device /dev/sde {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b0e8d8-7a07-43a1-a832-80d276552a39]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0b7601-4ac6-47c1-bba4-fa2d1ed7ed46]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ebfe58-21fa-4ad6-a80a-dff0139718c6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:17:38 user nova-compute[72904]: INFO nova.compute.claims [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Claim successful on node user
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2c8dfb-319a-404b-99b4-5d87d819eaa2]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260]
Aug 27 05:17:38 user nova-compute[72904]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773, portal: 172.16.0.220,3260] successful.
Aug 27 05:17:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f5641eb-37fe-490e-a59c-ef742a20a773 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af213d5-6298-40a6-a8f5-2849c2b246f2]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] <== disconnect_volume: return (311ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:17:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113459.2778063, 63df90c8-8277-4fae-8fd0-37d748101579 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] VM Resumed (Lifecycle Event)
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance spawned successfully.
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113459.2815127, 63df90c8-8277-4fae-8fd0-37d748101579 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] VM Started (Lifecycle Event)
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.policy [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59150e064dd54eb88d913d42561ed945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c656ac523cb9484894dd81447dfd37cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Creating image(s)
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "/opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "/opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "/opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:39 user nova-compute[72904]: INFO nova.compute.manager [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Took 31.25 seconds to build instance.
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6d9958e1-f710-476e-bd3b-705ed3c84b8f tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "63df90c8-8277-4fae-8fd0-37d748101579" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.341s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.objects.instance [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'flavor' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-250a7b11-74f4-4943-80c2-0b627165744a req-2985c67f-ddc0-48bc-a0f1-eaeac97c77d5 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-250a7b11-74f4-4943-80c2-0b627165744a req-2985c67f-ddc0-48bc-a0f1-eaeac97c77d5 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-250a7b11-74f4-4943-80c2-0b627165744a req-2985c67f-ddc0-48bc-a0f1-eaeac97c77d5 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-250a7b11-74f4-4943-80c2-0b627165744a req-2985c67f-ddc0-48bc-a0f1-eaeac97c77d5 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG nova.compute.manager [req-250a7b11-74f4-4943-80c2-0b627165744a req-2985c67f-ddc0-48bc-a0f1-eaeac97c77d5 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:39 user nova-compute[72904]: WARNING nova.compute.manager [req-250a7b11-74f4-4943-80c2-0b627165744a req-2985c67f-ddc0-48bc-a0f1-eaeac97c77d5 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state active and task_state None.
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-56eb1075-9dd2-48cf-92b6-a3ec78e9edcd tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.215s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk 1073741824" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG nova.network.neutron [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Successfully created port: 69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:40 user nova-compute[72904]: INFO nova.compute.manager [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Terminating instance
Aug 27 05:17:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.205s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Cannot resize image /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Ensure instance console log exists: /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Successfully updated port: 69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquired lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received event network-changed-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Refreshing instance network info cache due to event network-changed-69c64a7d-7c60-4779-a59d-df6a50f043c7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] Acquiring lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:17:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Instance destroyed successfully.
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lazy-loading 'resources' on Instance uuid 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1543510016',display_name='tempest-AttachVolumeTestJSON-server-1543510016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1543510016',id=31,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/pmgOxj+fDsZA+2YZ7gNHUZAlN99S8+jKflc0h9qgtBcdwOCiZCQR+NnQluFS/0fkV1NJmPC63zIuBzFc9bqoi0ezWWA11Jhf9MQjMpkfbApo20fp9wavZPTvc2j1ttw==',key_name='tempest-keypair-399054024',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:14:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a569f1146db846d7aabf09b5ca515d2d',ramdisk_id='',reservation_id='r-vj07d2pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-111990947',owner_user_name='tempest-AttachVolumeTestJSON-111990947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a89184799414da9ac135289cc4781ed',uuid=52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converting VIF {"id": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "address": "fa:16:3e:cc:a1:2a", "network": {"id": "af879cc7-73b1-40b0-a180-16e112bc2c21", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-463437720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a569f1146db846d7aabf09b5ca515d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64e969b-aa", "ovs_interfaceid": "b64e969b-aacc-4d31-8acf-46ad4e0fa40e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:a1:2a,bridge_name='br-int',has_traffic_filtering=True,id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64e969b-aa') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG os_vif [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:a1:2a,bridge_name='br-int',has_traffic_filtering=True,id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64e969b-aa') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb64e969b-aa, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:17:41 user nova-compute[72904]: INFO os_vif [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:a1:2a,bridge_name='br-int',has_traffic_filtering=True,id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e,network=Network(af879cc7-73b1-40b0-a180-16e112bc2c21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64e969b-aa')
Aug 27 05:17:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Deleting instance files /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8_del
Aug 27 05:17:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Deletion of /opt/stack/data/nova/instances/52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8_del complete
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:17:41 user nova-compute[72904]: INFO nova.compute.manager [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:17:41 user nova-compute[72904]: INFO nova.compute.manager [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Unrescuing
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquired lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-vif-unplugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] No waiting events found dispatching network-vif-unplugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-vif-unplugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] Acquiring lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] No waiting events found dispatching network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:41 user nova-compute[72904]: WARNING nova.compute.manager [req-5fbf3c1e-791c-4131-ac00-686f85fb4521 req-045d8c07-07d0-4135-b11a-3a9e5928d530 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received unexpected event network-vif-plugged-b64e969b-aacc-4d31-8acf-46ad4e0fa40e for instance with vm_state active and task_state deleting.
Aug 27 05:17:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating instance_info_cache with network_info: [{"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Releasing lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Instance network_info: |[{"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] Acquired lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.network.neutron [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Refreshing network info cache for port 69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Start _get_guest_xml network_info=[{"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:17:42 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:17:42 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-619566515',display_name='tempest-SnapshotDataIntegrityTests-server-619566515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-619566515',id=35,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQbMAGyEyckNdLs0I2889oD0fwVXnniMPA3C5dt5Jn/px+G+8+47ZufRbPdv723i4wEC/E8+ufDfTBi8xtrt63wQqfGxvFWDTyr9/o1zlPfC+UmJ5SlAM50fyVGJNlwnA==',key_name='tempest-keypair-212068823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c656ac523cb9484894dd81447dfd37cc',ramdisk_id='',reservation_id='r-nq5rz96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1219793608',owner_user_name='tempest-SnapshotDataIntegrityTests-1219793608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59150e064dd54eb88d913d42561ed945',uuid=f88b1d96-56b7-4595-af27-50993d25d527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Converting VIF {"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0a:42,bridge_name='br-int',has_traffic_filtering=True,id=69c64a7d-7c60-4779-a59d-df6a50f043c7,network=Network(e24fb848-8615-4e38-af0e-81584cbd9332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c64a7d-7c') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.objects.instance [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'pci_devices' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:17:42 user nova-compute[72904]:   <uuid>f88b1d96-56b7-4595-af27-50993d25d527</uuid>
Aug 27 05:17:42 user nova-compute[72904]:   <name>instance-00000023</name>
Aug 27 05:17:42 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:17:42 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:17:42 user nova-compute[72904]:   <metadata>
Aug 27 05:17:42 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:17:42 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:17:42 user nova-compute[72904]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-619566515</nova:name>
Aug 27 05:17:42 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:17:42</nova:creationTime>
Aug 27 05:17:42 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:17:42 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:17:42 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:17:42 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:17:42 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:17:42 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:17:42 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:17:42 user nova-compute[72904]:       <nova:owner>
Aug 27 05:17:42 user nova-compute[72904]:         <nova:user uuid="59150e064dd54eb88d913d42561ed945">tempest-SnapshotDataIntegrityTests-1219793608-project-member</nova:user>
Aug 27 05:17:42 user nova-compute[72904]:         <nova:project uuid="c656ac523cb9484894dd81447dfd37cc">tempest-SnapshotDataIntegrityTests-1219793608</nova:project>
Aug 27 05:17:42 user nova-compute[72904]:       </nova:owner>
Aug 27 05:17:42 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:17:42 user nova-compute[72904]:       <nova:ports>
Aug 27 05:17:42 user nova-compute[72904]:         <nova:port uuid="69c64a7d-7c60-4779-a59d-df6a50f043c7">
Aug 27 05:17:42 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 05:17:42 user nova-compute[72904]:         </nova:port>
Aug 27 05:17:42 user nova-compute[72904]:       </nova:ports>
Aug 27 05:17:42 user nova-compute[72904]:     </nova:instance>
Aug 27 05:17:42 user nova-compute[72904]:   </metadata>
Aug 27 05:17:42 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:17:42 user nova-compute[72904]:     <system>
Aug 27 05:17:42 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:17:42 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:17:42 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:17:42 user nova-compute[72904]:       <entry name="serial">f88b1d96-56b7-4595-af27-50993d25d527</entry>
Aug 27 05:17:42 user nova-compute[72904]:       <entry name="uuid">f88b1d96-56b7-4595-af27-50993d25d527</entry>
Aug 27 05:17:42 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:17:42 user nova-compute[72904]:     </system>
Aug 27 05:17:42 user nova-compute[72904]:   </sysinfo>
Aug 27 05:17:42 user nova-compute[72904]:   <os>
Aug 27 05:17:42 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:17:42 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:17:42 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:17:42 user nova-compute[72904]:   </os>
Aug 27 05:17:42 user nova-compute[72904]:   <features>
Aug 27 05:17:42 user nova-compute[72904]:     <acpi/>
Aug 27 05:17:42 user nova-compute[72904]:     <apic/>
Aug 27 05:17:42 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:17:42 user nova-compute[72904]:   </features>
Aug 27 05:17:42 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:17:42 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:17:42 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:17:42 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:17:42 user nova-compute[72904]:   </clock>
Aug 27 05:17:42 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:17:42 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:17:42 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:17:42 user nova-compute[72904]:   </cpu>
Aug 27 05:17:42 user nova-compute[72904]:   <devices>
Aug 27 05:17:42 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:17:42 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:17:42 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk"/>
Aug 27 05:17:42 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:17:42 user nova-compute[72904]:     </disk>
Aug 27 05:17:42 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:17:42 user nova-compute[72904]:       <mac address="fa:16:3e:c7:0a:42"/>
Aug 27 05:17:42 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:17:42 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:17:42 user nova-compute[72904]:       <target dev="tap69c64a7d-7c"/>
Aug 27 05:17:42 user nova-compute[72904]:     </interface>
Aug 27 05:17:42 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:17:42 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/console.log" append="off"/>
Aug 27 05:17:42 user nova-compute[72904]:     </serial>
Aug 27 05:17:42 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:17:42 user nova-compute[72904]:     <video>
Aug 27 05:17:42 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:17:42 user nova-compute[72904]:     </video>
Aug 27 05:17:42 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:17:42 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:17:42 user nova-compute[72904]:     </rng>
Aug 27 05:17:42 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:17:42 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:17:42 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:17:42 user nova-compute[72904]:     </memballoon>
Aug 27 05:17:42 user nova-compute[72904]:   </devices>
Aug 27 05:17:42 user nova-compute[72904]: </domain>
Aug 27 05:17:42 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-619566515',display_name='tempest-SnapshotDataIntegrityTests-server-619566515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-619566515',id=35,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQbMAGyEyckNdLs0I2889oD0fwVXnniMPA3C5dt5Jn/px+G+8+47ZufRbPdv723i4wEC/E8+ufDfTBi8xtrt63wQqfGxvFWDTyr9/o1zlPfC+UmJ5SlAM50fyVGJNlwnA==',key_name='tempest-keypair-212068823',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c656ac523cb9484894dd81447dfd37cc',ramdisk_id='',reservation_id='r-nq5rz96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1219793608',owner_user_name='tempest-SnapshotDataIntegrityTests-1219793608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59150e064dd54eb88d913d42561ed945',uuid=f88b1d96-56b7-4595-af27-50993d25d527,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Converting VIF {"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0a:42,bridge_name='br-int',has_traffic_filtering=True,id=69c64a7d-7c60-4779-a59d-df6a50f043c7,network=Network(e24fb848-8615-4e38-af0e-81584cbd9332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c64a7d-7c') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG os_vif [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0a:42,bridge_name='br-int',has_traffic_filtering=True,id=69c64a7d-7c60-4779-a59d-df6a50f043c7,network=Network(e24fb848-8615-4e38-af0e-81584cbd9332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c64a7d-7c') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69c64a7d-7c, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69c64a7d-7c, col_values=(('external_ids', {'iface-id': '69c64a7d-7c60-4779-a59d-df6a50f043c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:0a:42', 'vm-uuid': 'f88b1d96-56b7-4595-af27-50993d25d527'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:42 user nova-compute[72904]: INFO os_vif [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:0a:42,bridge_name='br-int',has_traffic_filtering=True,id=69c64a7d-7c60-4779-a59d-df6a50f043c7,network=Network(e24fb848-8615-4e38-af0e-81584cbd9332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c64a7d-7c')
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No VIF found with MAC fa:16:3e:c7:0a:42, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Releasing lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'flavor' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updated VIF entry in instance network info cache for port 69c64a7d-7c60-4779-a59d-df6a50f043c7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating instance_info_cache with network_info: [{"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8eaaddf0-7df6-4045-9338-da4ad6b67675 req-ae1a7556-441c-47d1-83f4-cf98ce55a354 service nova] Releasing lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:43 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Took 2.20 seconds to deallocate network for instance.
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-09fdcddf-f0ab-4cb8-aa47-e4a9285ffcd9 req-bb55d7df-9b7c-42d5-a9a7-1e3d8f3d66f5 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Received event network-vif-deleted-b64e969b-aacc-4d31-8acf-46ad4e0fa40e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:43 user nova-compute[72904]: INFO nova.compute.manager [req-09fdcddf-f0ab-4cb8-aa47-e4a9285ffcd9 req-bb55d7df-9b7c-42d5-a9a7-1e3d8f3d66f5 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Neutron deleted interface b64e969b-aacc-4d31-8acf-46ad4e0fa40e; detaching it from the instance and deleting it from the info cache
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-09fdcddf-f0ab-4cb8-aa47-e4a9285ffcd9 req-bb55d7df-9b7c-42d5-a9a7-1e3d8f3d66f5 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-09fdcddf-f0ab-4cb8-aa47-e4a9285ffcd9 req-bb55d7df-9b7c-42d5-a9a7-1e3d8f3d66f5 service nova] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Detach interface failed, port_id=b64e969b-aacc-4d31-8acf-46ad4e0fa40e, reason: Instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:43 user nova-compute[72904]: WARNING nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:43 user nova-compute[72904]: WARNING nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-changed-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Refreshing instance network info cache due to event network-changed-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Acquiring lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Acquired lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Refreshing network info cache for port 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:43 user nova-compute[72904]: INFO nova.compute.manager [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Terminating instance
Aug 27 05:17:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.622s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:44 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Deleted allocations for instance 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8
Aug 27 05:17:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:44 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance destroyed successfully.
Aug 27 05:17:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6f3577f4-3038-4174-baad-f3a543223ae3 tempest-AttachVolumeTestJSON-111990947 tempest-AttachVolumeTestJSON-111990947-project-member] Lock "52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.187s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG nova.network.neutron [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updated VIF entry in instance network info cache for port 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG nova.network.neutron [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updating instance_info_cache with network_info: [{"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a03b2171-483f-40f4-a0da-43bce72dc211 req-a613461b-cbe4-4be9-8661-e07b7fa711be service nova] Releasing lock "refresh_cache-be32e4e5-ed6d-4569-88a2-8fb43041e51e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Instance destroyed successfully.
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'resources' on Instance uuid be32e4e5-ed6d-4569-88a2-8fb43041e51e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1961842781',display_name='tempest-TestStampPattern-server-1961842781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1961842781',id=30,image_ref='39fe84d4-3a3d-433f-aa70-45b15e68ffba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkwT0EoE+efmSUPXfVnAKwZs3gchQqxEsGoSc6Z2oMKPhVS2FXSU8GCbc7XVowgKS4arjEQy/QXsY6Tc1MDzDaqgmC2lO07jOsRf3bFi2v/ztZO6o9+6NmJW5aEdh8ebg==',key_name='tempest-TestStampPattern-1730672637',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='773d80813c21429b836763fdeefb32fd',ramdisk_id='',reservation_id='r-7rcfb1nn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6c4f94ac-01ca-4028-a5d6-f3535edaaa7a',image_min_disk='1',image_min_ram='0',image_owner_id='773d80813c21429b836763fdeefb32fd',image_owner_project_name='tempest-TestStampPattern-885956166',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-885956166-project-member',image_user_id='21601eb4d7bd479aaaa27ed3040f4dd1',owner_project_name='tempest-TestStampPattern-885956166',owner_user_name='tempest-TestStampPattern-885956166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:14:52Z,user_data=None,user_id='21601eb4d7bd479aaaa27ed3040f4dd1',uuid=be32e4e5-ed6d-4569-88a2-8fb43041e51e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converting VIF {"id": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "address": "fa:16:3e:77:1f:38", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap701f5cbe-37", "ovs_interfaceid": "701f5cbe-3712-479a-a9cb-fed1fa3cd6d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:1f:38,bridge_name='br-int',has_traffic_filtering=True,id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap701f5cbe-37') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG os_vif [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:1f:38,bridge_name='br-int',has_traffic_filtering=True,id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap701f5cbe-37') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap701f5cbe-37, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:45 user nova-compute[72904]: INFO os_vif [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:1f:38,bridge_name='br-int',has_traffic_filtering=True,id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap701f5cbe-37')
Aug 27 05:17:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Deleting instance files /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e_del
Aug 27 05:17:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Deletion of /opt/stack/data/nova/instances/be32e4e5-ed6d-4569-88a2-8fb43041e51e_del complete
Aug 27 05:17:45 user nova-compute[72904]: INFO nova.compute.manager [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-vif-unplugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] No waiting events found dispatching network-vif-unplugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-vif-unplugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Acquiring lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] No waiting events found dispatching network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:45 user nova-compute[72904]: WARNING nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received unexpected event network-vif-plugged-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 for instance with vm_state active and task_state deleting.
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received event network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] No waiting events found dispatching network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:45 user nova-compute[72904]: WARNING nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received unexpected event network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 for instance with vm_state building and task_state spawning.
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received event network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] No waiting events found dispatching network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:45 user nova-compute[72904]: WARNING nova.compute.manager [req-b69303af-1010-42ae-888f-d761b136f07c req-f0de1ed6-64c7-42e5-82f7-8d3de8cf0726 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received unexpected event network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 for instance with vm_state building and task_state spawning.
Aug 27 05:17:46 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:46 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Took 0.65 seconds to deallocate network for instance.
Aug 27 05:17:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f8493c9-413f-47ed-9937-80a8651df591 req-6bb2a044-ea48-485e-8906-df6d47ab8342 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Received event network-vif-deleted-701f5cbe-3712-479a-a9cb-fed1fa3cd6d7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:46 user nova-compute[72904]: INFO nova.compute.manager [req-1f8493c9-413f-47ed-9937-80a8651df591 req-6bb2a044-ea48-485e-8906-df6d47ab8342 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Neutron deleted interface 701f5cbe-3712-479a-a9cb-fed1fa3cd6d7; detaching it from the instance and deleting it from the info cache
Aug 27 05:17:46 user nova-compute[72904]: DEBUG nova.network.neutron [req-1f8493c9-413f-47ed-9937-80a8651df591 req-6bb2a044-ea48-485e-8906-df6d47ab8342 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f8493c9-413f-47ed-9937-80a8651df591 req-6bb2a044-ea48-485e-8906-df6d47ab8342 service nova] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Detach interface failed, port_id=701f5cbe-3712-479a-a9cb-fed1fa3cd6d7, reason: Instance be32e4e5-ed6d-4569-88a2-8fb43041e51e could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:46 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Deleted allocations for instance be32e4e5-ed6d-4569-88a2-8fb43041e51e
Aug 27 05:17:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5972a152-00f1-42d1-9196-9555f8ee040e tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "be32e4e5-ed6d-4569-88a2-8fb43041e51e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.942s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113467.589894, f88b1d96-56b7-4595-af27-50993d25d527 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:17:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] VM Resumed (Lifecycle Event)
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Instance spawned successfully.
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:17:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113467.5915234, f88b1d96-56b7-4595-af27-50993d25d527 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:17:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] VM Started (Lifecycle Event)
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:17:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:17:47 user nova-compute[72904]: INFO nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Took 8.25 seconds to spawn the instance on the hypervisor.
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:47 user nova-compute[72904]: INFO nova.compute.manager [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Took 9.22 seconds to build instance.
Aug 27 05:17:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-99ee3783-dff3-48f3-9caa-3e2643dd9ea0 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.332s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:47 user nova-compute[72904]: WARNING nova.compute.manager [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:17:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:17:47 user nova-compute[72904]: WARNING nova.compute.manager [req-e3dc35dc-26e5-45b6-91ae-4949d4db0096 req-efd96287-d79e-4703-954f-4228c9a0db63 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113468.5576565, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:17:48 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] VM Resumed (Lifecycle Event)
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6a7cd98f-e714-4482-ad85-d7956098e4ce tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:17:48 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113468.5591083, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:17:48 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] VM Started (Lifecycle Event)
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:17:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:56 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113461.1359785, 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:17:56 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] VM Stopped (Lifecycle Event)
Aug 27 05:17:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6ae90428-c802-42d3-b760-50af1f1ae330 None None] [instance: 52cb884c-e57a-4e07-bd5e-8ce41c8e2dd8] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:17:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:17:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:17:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing instance network info cache due to event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:17:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] Acquiring lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:17:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] Acquired lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:17:59 user nova-compute[72904]: DEBUG nova.network.neutron [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:18:00 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113465.263627, be32e4e5-ed6d-4569-88a2-8fb43041e51e => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:18:00 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] VM Stopped (Lifecycle Event)
Aug 27 05:18:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1246d3b1-ae32-4772-9008-1d011f197e9e None None] [instance: be32e4e5-ed6d-4569-88a2-8fb43041e51e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:00 user nova-compute[72904]: DEBUG nova.network.neutron [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updated VIF entry in instance network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:18:00 user nova-compute[72904]: DEBUG nova.network.neutron [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3e216ef0-81d1-47c4-a19e-2c9dabc67e23 req-6eb4779f-1417-47b7-a8b8-dbf109cacd7e service nova] Releasing lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Shelving
Aug 27 05:18:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-fa3e1647-df84-4cf9-95ea-a0d27bc0dcc8 req-ef81ff10-1101-40c0-820e-ac02386ed7ca service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-unplugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fa3e1647-df84-4cf9-95ea-a0d27bc0dcc8 req-ef81ff10-1101-40c0-820e-ac02386ed7ca service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fa3e1647-df84-4cf9-95ea-a0d27bc0dcc8 req-ef81ff10-1101-40c0-820e-ac02386ed7ca service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fa3e1647-df84-4cf9-95ea-a0d27bc0dcc8 req-ef81ff10-1101-40c0-820e-ac02386ed7ca service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:07 user nova-compute[72904]: DEBUG nova.compute.manager [req-fa3e1647-df84-4cf9-95ea-a0d27bc0dcc8 req-ef81ff10-1101-40c0-820e-ac02386ed7ca service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-unplugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:07 user nova-compute[72904]: WARNING nova.compute.manager [req-fa3e1647-df84-4cf9-95ea-a0d27bc0dcc8 req-ef81ff10-1101-40c0-820e-ac02386ed7ca service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received unexpected event network-vif-unplugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with vm_state active and task_state shelving.
Aug 27 05:18:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance destroyed successfully.
Aug 27 05:18:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Beginning cold snapshot process
Aug 27 05:18:08 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:18:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk /opt/stack/data/nova/instances/snapshots/tmpfvakhqh3/0b574f1935b64a92a2399771724df060 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk /opt/stack/data/nova/instances/snapshots/tmpfvakhqh3/0b574f1935b64a92a2399771724df060" returned: 0 in 0.559s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Snapshot extracted, beginning image upload
Aug 27 05:18:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-4df35735-53aa-468a-a66f-afc66de16608 req-dc448a18-c375-4f5d-afd8-38b7f9e35a13 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4df35735-53aa-468a-a66f-afc66de16608 req-dc448a18-c375-4f5d-afd8-38b7f9e35a13 service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4df35735-53aa-468a-a66f-afc66de16608 req-dc448a18-c375-4f5d-afd8-38b7f9e35a13 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4df35735-53aa-468a-a66f-afc66de16608 req-dc448a18-c375-4f5d-afd8-38b7f9e35a13 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-4df35735-53aa-468a-a66f-afc66de16608 req-dc448a18-c375-4f5d-afd8-38b7f9e35a13 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:09 user nova-compute[72904]: WARNING nova.compute.manager [req-4df35735-53aa-468a-a66f-afc66de16608 req-dc448a18-c375-4f5d-afd8-38b7f9e35a13 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received unexpected event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with vm_state active and task_state shelving_image_uploading.
Aug 27 05:18:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:11 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Snapshot image upload complete
Aug 27 05:18:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:11 user nova-compute[72904]: INFO nova.compute.manager [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Shelve offloading
Aug 27 05:18:11 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance destroyed successfully.
Aug 27 05:18:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquired lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:18:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Releasing lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:12 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance destroyed successfully.
Aug 27 05:18:12 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'resources' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:18:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1446970509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1446970509',id=32,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiQrgc7A7FjqhVOjH4sy6MrmRYpNDFLhOIbKzqYBivxl7GfmXPfG/csWNrDOmp9PJob43UD+0UUaeVIkzTitEjgvxsrO8vRi0Dt1cbc5yB/9L4HLwYYIqo/agkI6byQoQ==',key_name='tempest-keypair-989204785',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:16:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-ib4vtnbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member',shelved_at='2023-08-27T05:18:11.518743',shelved_host='user',shelved_image_id='361a8c5f-fe29-43ba-864f-45eab12a8b29'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:18:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=103ea467-b0be-4221-81d4-ef2bbbfddc88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:18:12 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:18:12 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:18:12 user nova-compute[72904]: DEBUG os_vif [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:18:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa31f90c2-af, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:18:13 user nova-compute[72904]: INFO os_vif [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af')
Aug 27 05:18:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Deleting instance files /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88_del
Aug 27 05:18:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Deletion of /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88_del complete
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing instance network info cache due to event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] Acquiring lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] Acquired lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.network.neutron [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:18:13 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Deleted allocations for instance 103ea467-b0be-4221-81d4-ef2bbbfddc88
Aug 27 05:18:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'numa_topology' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.objects.base [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<103ea467-b0be-4221-81d4-ef2bbbfddc88> lazy-loaded attributes: resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.network.neutron [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updated VIF entry in instance network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.network.neutron [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa31f90c2-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f412dc81-c9ba-4867-8686-36d94e35876b req-5b2b1810-93c5-425e-9a9f-d8f74db3b916 service nova] Releasing lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6c85e9a0-3c83-4931-bc8c-e8fc409c201c tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.632s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'flavor' on Instance uuid 7fe87c87-d6bf-4cee-a0f3-67b563122d18 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:18:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:18 user nova-compute[72904]: INFO nova.compute.manager [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Attaching volume f490002a-8f4c-4a54-a1c7-f73dfd7351e7 to /dev/vdb
Aug 27 05:18:18 user nova-compute[72904]: DEBUG os_brick.utils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08082ab-4997-4fc8-a4d9-3d04bb50aaff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8f2b33-4f83-4406-9d96-cda71a135fb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[89233f56-7af0-4e47-9a9b-dbb31f6b77f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebb0ac5-99e7-4cc9-a485-5e462ab929a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:18:18 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[df00446c-4e7b-4104-9c57-28d9de4c938a]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG os_brick.utils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating existing volume attachment record: ab579f48-9f59-42e0-89ce-29a48cb55ef5 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:18:18 user nova-compute[72904]: INFO nova.compute.claims [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Claim successful on node user
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:18:18 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:18:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:18:18 user nova-compute[72904]: INFO nova.virt.block_device [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Booting with volume ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 at /dev/vda
Aug 27 05:18:19 user nova-compute[72904]: DEBUG os_brick.utils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[927eed06-90fd-456b-8628-5099346e0faa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac1fcf3-66ee-42ce-9704-3e581886f6ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93142ba-6243-407f-bc1e-ed249c6d5f94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[46431e8e-14c9-483e-97e5-5d11e10c02a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:18:19 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:18:19 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[822ba215-9d97-4e60-bdf9-4e0380daba44]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG os_brick.utils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating existing volume attachment record: c49825b8-a346-4dd7-b29e-9a8eaa3fad0f {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:18:19 user nova-compute[72904]: DEBUG nova.policy [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14df3bfebe7c43dca0a4ef2ee90f995b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553916b16f8404ca042ad82b503e6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:18:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Successfully created port: 13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Successfully updated port: 13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquired lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-changed-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Refreshing instance network info cache due to event network-changed-13955c19-f1f4-466c-8e3a-5ccf423b2569. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] Acquiring lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Releasing lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance network_info: |[{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] Acquired lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:21 user nova-compute[72904]: DEBUG nova.network.neutron [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Refreshing network info cache for port 13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:18:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updated VIF entry in instance network info cache for port 13955c19-f1f4-466c-8e3a-5ccf423b2569. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:18:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e7514426-f38a-4330-af6f-7de90949e95b req-a11bb976-c68d-4f34-838a-09d29df8897b service nova] Releasing lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:22 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113487.8714983, 103ea467-b0be-4221-81d4-ef2bbbfddc88 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:18:22 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] VM Stopped (Lifecycle Event)
Aug 27 05:18:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-06c5de4c-d0dc-4fd2-a2b2-0f7967da9062 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzOLqHBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:18:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:18:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:18:30 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[032f2faf-9779-4d1b-b7f4-29abfc3bf589]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:18:30 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c87fe66-04bd-4894-afed-3e8e7400eaaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7] added
Aug 27 05:18:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4512488-3403-4eba-acc1-defae6258180]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.051s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99e5ac-ffc1-4bfc-9323-e4c2561a0343]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzOLqHBY {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzOLqHBY" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[549c03c7-3fc1-4509-8f81-fcc24dcfb294]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JzOLqHBY'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.060s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41397e-f680-4955-80f9-622ccc343505]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61b85b9-9c21-4934-9a4e-53aa89779504]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547506d-e9be-48d8-9724-4cd4e81b9db8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260]
Aug 27 05:18:30 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260] successful.
Aug 27 05:18:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4625c4b6-61d2-4f43-a38e-1587db4b537d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b4ffe7-020b-497b-b4b5-5d90b588b911]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:18:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ada34d-fafa-4006-8cac-66b0336a7d68]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:18:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzOLqHBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:18:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Creating image(s)
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Ensure instance console log exists: /opt/stack/data/nova/instances/12da6d24-08c6-4b62-bef3-3dbc05b28020/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Start _get_guest_xml network_info=[{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c49825b8-a346-4dd7-b29e-9a8eaa3fad0f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12da6d24-08c6-4b62-bef3-3dbc05b28020', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea1cbb08-6b6b-42af-b6d5-54c76ce769d7', 'serial': 'ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:18:31 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:18:31 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:18:31 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26165323164636235', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165323164636235', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.264s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:18:31 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:18:31 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'flavor' on Instance uuid 7fe87c87-d6bf-4cee-a0f3-67b563122d18 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb134a6-1876-4179-8815-c2d9375afa41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:18:31 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:18:31 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:18:31 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:18:31 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:18:31 user nova-compute[72904]:   <serial>f490002a-8f4c-4a54-a1c7-f73dfd7351e7</serial>
Aug 27 05:18:31 user nova-compute[72904]: </disk>
Aug 27 05:18:31 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ea6b15-c81d-4939-9782-1ad131c7fdac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7] added
Aug 27 05:18:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f886dc2c-52cb-4931-8120-5506a55a72b8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae32c9-705b-4c0f-b634-4e406b87bba9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noNWRVwA {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noNWRVwA" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae023fe-636c-4068-a39b-c6926573f03c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'noNWRVwA'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c37269-c5c7-42cd-9b99-d0b9ad18fb52]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead6daf4-c57d-472f-974f-e294012414d8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:31 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:31 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:31 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:18:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:31 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:31 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:31 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:18:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0296aff5-a7d9-4a33-8fc3-469918ff241c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]
Aug 27 05:18:31 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.
Aug 27 05:18:31 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec180237-e595-4860-9a37-99c09ea6cb3c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:18:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2e7a6b-ad21-4131-9986-c48bea93055e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:18:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc75e16-5da3-4650-921e-8bfce050217f]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] No VIF found with MAC fa:16:3e:e6:e7:f2, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1fa632ff-0f26-4d18-a177-e37304307a2c tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.184s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.007s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:18:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== connect_volume: return (1622ms) {'type': 'block', 'scsi_wwn': '23537316430616666', 'path': '/dev/sde'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537316430616666', 'path': '/dev/sde'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1439837580',display_name='tempest-ServerActionsTestOtherA-server-1439837580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1439837580',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-fq2wl9pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=12da6d24-08c6-4b62-bef3-3dbc05b28020,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'pci_devices' on Instance uuid 12da6d24-08c6-4b62-bef3-3dbc05b28020 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:18:33 user nova-compute[72904]:   <uuid>12da6d24-08c6-4b62-bef3-3dbc05b28020</uuid>
Aug 27 05:18:33 user nova-compute[72904]:   <name>instance-00000024</name>
Aug 27 05:18:33 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:18:33 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:18:33 user nova-compute[72904]:   <metadata>
Aug 27 05:18:33 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:18:33 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:18:33 user nova-compute[72904]:       <nova:name>tempest-ServerActionsTestOtherA-server-1439837580</nova:name>
Aug 27 05:18:33 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:18:31</nova:creationTime>
Aug 27 05:18:33 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:18:33 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:18:33 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:18:33 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:18:33 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:18:33 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:18:33 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:18:33 user nova-compute[72904]:       <nova:owner>
Aug 27 05:18:33 user nova-compute[72904]:         <nova:user uuid="14df3bfebe7c43dca0a4ef2ee90f995b">tempest-ServerActionsTestOtherA-886850923-project-member</nova:user>
Aug 27 05:18:33 user nova-compute[72904]:         <nova:project uuid="a553916b16f8404ca042ad82b503e6c7">tempest-ServerActionsTestOtherA-886850923</nova:project>
Aug 27 05:18:33 user nova-compute[72904]:       </nova:owner>
Aug 27 05:18:33 user nova-compute[72904]:       <nova:ports>
Aug 27 05:18:33 user nova-compute[72904]:         <nova:port uuid="13955c19-f1f4-466c-8e3a-5ccf423b2569">
Aug 27 05:18:33 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:18:33 user nova-compute[72904]:         </nova:port>
Aug 27 05:18:33 user nova-compute[72904]:       </nova:ports>
Aug 27 05:18:33 user nova-compute[72904]:     </nova:instance>
Aug 27 05:18:33 user nova-compute[72904]:   </metadata>
Aug 27 05:18:33 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:18:33 user nova-compute[72904]:     <system>
Aug 27 05:18:33 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:18:33 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:18:33 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:18:33 user nova-compute[72904]:       <entry name="serial">12da6d24-08c6-4b62-bef3-3dbc05b28020</entry>
Aug 27 05:18:33 user nova-compute[72904]:       <entry name="uuid">12da6d24-08c6-4b62-bef3-3dbc05b28020</entry>
Aug 27 05:18:33 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:18:33 user nova-compute[72904]:     </system>
Aug 27 05:18:33 user nova-compute[72904]:   </sysinfo>
Aug 27 05:18:33 user nova-compute[72904]:   <os>
Aug 27 05:18:33 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:18:33 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:18:33 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:18:33 user nova-compute[72904]:   </os>
Aug 27 05:18:33 user nova-compute[72904]:   <features>
Aug 27 05:18:33 user nova-compute[72904]:     <acpi/>
Aug 27 05:18:33 user nova-compute[72904]:     <apic/>
Aug 27 05:18:33 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:18:33 user nova-compute[72904]:   </features>
Aug 27 05:18:33 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:18:33 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:18:33 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:18:33 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:18:33 user nova-compute[72904]:   </clock>
Aug 27 05:18:33 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:18:33 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:18:33 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:18:33 user nova-compute[72904]:   </cpu>
Aug 27 05:18:33 user nova-compute[72904]:   <devices>
Aug 27 05:18:33 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:18:33 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:18:33 user nova-compute[72904]:       <source dev="/dev/sde"/>
Aug 27 05:18:33 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:18:33 user nova-compute[72904]:       <serial>ea1cbb08-6b6b-42af-b6d5-54c76ce769d7</serial>
Aug 27 05:18:33 user nova-compute[72904]:     </disk>
Aug 27 05:18:33 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:18:33 user nova-compute[72904]:       <mac address="fa:16:3e:ad:28:f1"/>
Aug 27 05:18:33 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:18:33 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:18:33 user nova-compute[72904]:       <target dev="tap13955c19-f1"/>
Aug 27 05:18:33 user nova-compute[72904]:     </interface>
Aug 27 05:18:33 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:18:33 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/12da6d24-08c6-4b62-bef3-3dbc05b28020/console.log" append="off"/>
Aug 27 05:18:33 user nova-compute[72904]:     </serial>
Aug 27 05:18:33 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:18:33 user nova-compute[72904]:     <video>
Aug 27 05:18:33 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:18:33 user nova-compute[72904]:     </video>
Aug 27 05:18:33 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:18:33 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:18:33 user nova-compute[72904]:     </rng>
Aug 27 05:18:33 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:18:33 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:18:33 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:18:33 user nova-compute[72904]:     </memballoon>
Aug 27 05:18:33 user nova-compute[72904]:   </devices>
Aug 27 05:18:33 user nova-compute[72904]: </domain>
Aug 27 05:18:33 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1439837580',display_name='tempest-ServerActionsTestOtherA-server-1439837580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1439837580',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-fq2wl9pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:18:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=12da6d24-08c6-4b62-bef3-3dbc05b28020,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG os_vif [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13955c19-f1, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13955c19-f1, col_values=(('external_ids', {'iface-id': '13955c19-f1f4-466c-8e3a-5ccf423b2569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:28:f1', 'vm-uuid': '12da6d24-08c6-4b62-bef3-3dbc05b28020'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:33 user nova-compute[72904]: INFO os_vif [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1')
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No VIF found with MAC fa:16:3e:ad:28:f1, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3f052f00-b17c-4942-bb7d-42893f741e86 req-cdec4ae8-6ab1-4205-9394-dd166324adcf service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3f052f00-b17c-4942-bb7d-42893f741e86 req-cdec4ae8-6ab1-4205-9394-dd166324adcf service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3f052f00-b17c-4942-bb7d-42893f741e86 req-cdec4ae8-6ab1-4205-9394-dd166324adcf service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3f052f00-b17c-4942-bb7d-42893f741e86 req-cdec4ae8-6ab1-4205-9394-dd166324adcf service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-3f052f00-b17c-4942-bb7d-42893f741e86 req-cdec4ae8-6ab1-4205-9394-dd166324adcf service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:34 user nova-compute[72904]: WARNING nova.compute.manager [req-3f052f00-b17c-4942-bb7d-42893f741e86 req-cdec4ae8-6ab1-4205-9394-dd166324adcf service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received unexpected event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with vm_state building and task_state spawning.
Aug 27 05:18:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.301s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing instance network info cache due to event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] Acquiring lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] Acquired lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updated VIF entry in instance network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-728c5553-4d19-438f-9fb6-4de7fc7c0c6c req-ce4a88ef-7a30-45f2-b239-f007ab9cb2d3 service nova] Releasing lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113516.9553566, 12da6d24-08c6-4b62-bef3-3dbc05b28020 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:18:36 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] VM Resumed (Lifecycle Event)
Aug 27 05:18:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:18:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:18:37 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance spawned successfully.
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:18:37 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113516.9565089, 12da6d24-08c6-4b62-bef3-3dbc05b28020 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:18:37 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] VM Started (Lifecycle Event)
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:18:37 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:18:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:18:37 user nova-compute[72904]: INFO nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-191739d6-1c37-42ee-b804-2a6c1b05e0ac req-b10c5778-de19-4c2b-9a93-667cf9c08a98 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-191739d6-1c37-42ee-b804-2a6c1b05e0ac req-b10c5778-de19-4c2b-9a93-667cf9c08a98 service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-191739d6-1c37-42ee-b804-2a6c1b05e0ac req-b10c5778-de19-4c2b-9a93-667cf9c08a98 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-191739d6-1c37-42ee-b804-2a6c1b05e0ac req-b10c5778-de19-4c2b-9a93-667cf9c08a98 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-191739d6-1c37-42ee-b804-2a6c1b05e0ac req-b10c5778-de19-4c2b-9a93-667cf9c08a98 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:37 user nova-compute[72904]: WARNING nova.compute.manager [req-191739d6-1c37-42ee-b804-2a6c1b05e0ac req-b10c5778-de19-4c2b-9a93-667cf9c08a98 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received unexpected event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with vm_state building and task_state spawning.
Aug 27 05:18:37 user nova-compute[72904]: INFO nova.compute.manager [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Took 19.30 seconds to build instance.
Aug 27 05:18:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:18:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7269MB free_disk=25.03048324584961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e767c098-870e-42f7-8dde-a0fadc716aba tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.404s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 63df90c8-8277-4fae-8fd0-37d748101579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:18:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing instance network info cache due to event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] Acquiring lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] Acquired lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG nova.network.neutron [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updated VIF entry in instance network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG nova.network.neutron [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:39 user nova-compute[72904]: INFO nova.compute.manager [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Rebooting instance
Aug 27 05:18:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e5733916-38a9-4fb8-8465-6299f0389696 req-3c419cbe-d5b8-4101-96b7-88500711bdce service nova] Releasing lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquired lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Releasing lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid 4fba85dc-5514-4bc1-a731-1cd1af6da152 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updating instance_info_cache with network_info: [{"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-4fba85dc-5514-4bc1-a731-1cd1af6da152" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:18:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:18:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-a167461e-74ab-4c54-9a1e-89140210810a req-fbe8ebda-e857-42fe-a0bd-6fab4dc62509 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-unplugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a167461e-74ab-4c54-9a1e-89140210810a req-fbe8ebda-e857-42fe-a0bd-6fab4dc62509 service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a167461e-74ab-4c54-9a1e-89140210810a req-fbe8ebda-e857-42fe-a0bd-6fab4dc62509 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a167461e-74ab-4c54-9a1e-89140210810a req-fbe8ebda-e857-42fe-a0bd-6fab4dc62509 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-a167461e-74ab-4c54-9a1e-89140210810a req-fbe8ebda-e857-42fe-a0bd-6fab4dc62509 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-unplugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:42 user nova-compute[72904]: WARNING nova.compute.manager [req-a167461e-74ab-4c54-9a1e-89140210810a req-fbe8ebda-e857-42fe-a0bd-6fab4dc62509 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received unexpected event network-vif-unplugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with vm_state active and task_state reboot_started.
Aug 27 05:18:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance shutdown successfully.
Aug 27 05:18:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG nova.compute.manager [req-7e4c8de8-79c7-4f73-949f-6f6516a022e5 req-8dc9e4bf-d333-4efc-8a3b-888a652e758a service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7e4c8de8-79c7-4f73-949f-6f6516a022e5 req-8dc9e4bf-d333-4efc-8a3b-888a652e758a service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7e4c8de8-79c7-4f73-949f-6f6516a022e5 req-8dc9e4bf-d333-4efc-8a3b-888a652e758a service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7e4c8de8-79c7-4f73-949f-6f6516a022e5 req-8dc9e4bf-d333-4efc-8a3b-888a652e758a service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG nova.compute.manager [req-7e4c8de8-79c7-4f73-949f-6f6516a022e5 req-8dc9e4bf-d333-4efc-8a3b-888a652e758a service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:44 user nova-compute[72904]: WARNING nova.compute.manager [req-7e4c8de8-79c7-4f73-949f-6f6516a022e5 req-8dc9e4bf-d333-4efc-8a3b-888a652e758a service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received unexpected event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with vm_state active and task_state reboot_started.
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 7fe87c87-d6bf-4cee-a0f3-67b563122d18 due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113526.3592741, 7fe87c87-d6bf-4cee-a0f3-67b563122d18 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:18:46 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] VM Resumed (Lifecycle Event)
Aug 27 05:18:46 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance running successfully.
Aug 27 05:18:46 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance soft rebooted successfully.
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:46 user nova-compute[72904]: WARNING nova.compute.manager [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received unexpected event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with vm_state active and task_state reboot_started.
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:46 user nova-compute[72904]: WARNING nova.compute.manager [req-05325713-48de-4e08-b12c-dd212e86e560 req-80c62087-efc1-4f61-9fa0-2c980fd10a04 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received unexpected event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with vm_state active and task_state reboot_started.
Aug 27 05:18:46 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113526.3611474, 7fe87c87-d6bf-4cee-a0f3-67b563122d18 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:18:46 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] VM Started (Lifecycle Event)
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bfae1c79-662b-4655-913e-b65103311f1a tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.578s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:18:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-changed-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Refreshing instance network info cache due to event network-changed-28a8a801-ba7a-46bc-b814-6032fd49ebb6. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] Acquiring lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] Acquired lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Refreshing network info cache for port 28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:51 user nova-compute[72904]: INFO nova.compute.manager [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Terminating instance
Aug 27 05:18:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-bbc9bbbc-c5a9-4781-85a9-28f50c4c3b6a req-9e0588fb-ebd0-444a-945d-bfc8383a7daa service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-vif-unplugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bbc9bbbc-c5a9-4781-85a9-28f50c4c3b6a req-9e0588fb-ebd0-444a-945d-bfc8383a7daa service nova] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bbc9bbbc-c5a9-4781-85a9-28f50c4c3b6a req-9e0588fb-ebd0-444a-945d-bfc8383a7daa service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bbc9bbbc-c5a9-4781-85a9-28f50c4c3b6a req-9e0588fb-ebd0-444a-945d-bfc8383a7daa service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-bbc9bbbc-c5a9-4781-85a9-28f50c4c3b6a req-9e0588fb-ebd0-444a-945d-bfc8383a7daa service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] No waiting events found dispatching network-vif-unplugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-bbc9bbbc-c5a9-4781-85a9-28f50c4c3b6a req-9e0588fb-ebd0-444a-945d-bfc8383a7daa service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-vif-unplugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:18:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updated VIF entry in instance network info cache for port 28a8a801-ba7a-46bc-b814-6032fd49ebb6. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updating instance_info_cache with network_info: [{"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7aaccd9e-29a4-4987-9d6e-6613671bee15 req-87dd2b3e-74e0-433e-862f-ce687c04399d service nova] Releasing lock "refresh_cache-6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:18:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Instance destroyed successfully.
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lazy-loading 'resources' on Instance uuid 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-940434153',display_name='tempest-TestStampPattern-server-940434153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-940434153',id=26,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkwT0EoE+efmSUPXfVnAKwZs3gchQqxEsGoSc6Z2oMKPhVS2FXSU8GCbc7XVowgKS4arjEQy/QXsY6Tc1MDzDaqgmC2lO07jOsRf3bFi2v/ztZO6o9+6NmJW5aEdh8ebg==',key_name='tempest-TestStampPattern-1730672637',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:11:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='773d80813c21429b836763fdeefb32fd',ramdisk_id='',reservation_id='r-1spg85uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-885956166',owner_user_name='tempest-TestStampPattern-885956166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:14:43Z,user_data=None,user_id='21601eb4d7bd479aaaa27ed3040f4dd1',uuid=6c4f94ac-01ca-4028-a5d6-f3535edaaa7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converting VIF {"id": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "address": "fa:16:3e:1c:87:d8", "network": {"id": "dac80adb-0165-486c-aeef-a3c976af2615", "bridge": "br-int", "label": "tempest-TestStampPattern-513453947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "773d80813c21429b836763fdeefb32fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28a8a801-ba", "ovs_interfaceid": "28a8a801-ba7a-46bc-b814-6032fd49ebb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:87:d8,bridge_name='br-int',has_traffic_filtering=True,id=28a8a801-ba7a-46bc-b814-6032fd49ebb6,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a8a801-ba') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG os_vif [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:87:d8,bridge_name='br-int',has_traffic_filtering=True,id=28a8a801-ba7a-46bc-b814-6032fd49ebb6,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a8a801-ba') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28a8a801-ba, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:52 user nova-compute[72904]: INFO os_vif [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:87:d8,bridge_name='br-int',has_traffic_filtering=True,id=28a8a801-ba7a-46bc-b814-6032fd49ebb6,network=Network(dac80adb-0165-486c-aeef-a3c976af2615),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28a8a801-ba')
Aug 27 05:18:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Deleting instance files /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a_del
Aug 27 05:18:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Deletion of /opt/stack/data/nova/instances/6c4f94ac-01ca-4028-a5d6-f3535edaaa7a_del complete
Aug 27 05:18:52 user nova-compute[72904]: INFO nova.compute.manager [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 27 05:18:52 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:18:52 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:53 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Took 0.60 seconds to deallocate network for instance.
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-546234de-aa0e-4e44-b318-e3beb743f8c3 req-ef8df142-1e95-44a9-916c-2debf9ef4396 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-vif-deleted-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:53 user nova-compute[72904]: INFO nova.compute.manager [req-546234de-aa0e-4e44-b318-e3beb743f8c3 req-ef8df142-1e95-44a9-916c-2debf9ef4396 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Neutron deleted interface 28a8a801-ba7a-46bc-b814-6032fd49ebb6; detaching it from the instance and deleting it from the info cache
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.network.neutron [req-546234de-aa0e-4e44-b318-e3beb743f8c3 req-ef8df142-1e95-44a9-916c-2debf9ef4396 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-546234de-aa0e-4e44-b318-e3beb743f8c3 req-ef8df142-1e95-44a9-916c-2debf9ef4396 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Detach interface failed, port_id=28a8a801-ba7a-46bc-b814-6032fd49ebb6, reason: Instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:53 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Deleted allocations for instance 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a
Aug 27 05:18:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4fb10ece-8514-44d0-a31f-eb26c295547c tempest-TestStampPattern-885956166 tempest-TestStampPattern-885956166-project-member] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.172s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-656b4216-d450-488a-8be6-4b2080186adb req-21bc2349-d292-49cb-8519-7ec64023bc66 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received event network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-656b4216-d450-488a-8be6-4b2080186adb req-21bc2349-d292-49cb-8519-7ec64023bc66 service nova] Acquiring lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-656b4216-d450-488a-8be6-4b2080186adb req-21bc2349-d292-49cb-8519-7ec64023bc66 service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-656b4216-d450-488a-8be6-4b2080186adb req-21bc2349-d292-49cb-8519-7ec64023bc66 service nova] Lock "6c4f94ac-01ca-4028-a5d6-f3535edaaa7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:18:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-656b4216-d450-488a-8be6-4b2080186adb req-21bc2349-d292-49cb-8519-7ec64023bc66 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] No waiting events found dispatching network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:18:53 user nova-compute[72904]: WARNING nova.compute.manager [req-656b4216-d450-488a-8be6-4b2080186adb req-21bc2349-d292-49cb-8519-7ec64023bc66 service nova] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Received unexpected event network-vif-plugged-28a8a801-ba7a-46bc-b814-6032fd49ebb6 for instance with vm_state deleted and task_state None.
Aug 27 05:18:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:18:59 user nova-compute[72904]: INFO nova.compute.manager [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Rescuing
Aug 27 05:18:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:18:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:18:59 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:18:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updating instance_info_cache with network_info: [{"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-ce6d3612-ba67-48e2-9746-c4739dd70f70 req-8cf83ab8-34e6-4e7d-981f-9dd54687680d service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ce6d3612-ba67-48e2-9746-c4739dd70f70 req-8cf83ab8-34e6-4e7d-981f-9dd54687680d service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ce6d3612-ba67-48e2-9746-c4739dd70f70 req-8cf83ab8-34e6-4e7d-981f-9dd54687680d service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ce6d3612-ba67-48e2-9746-c4739dd70f70 req-8cf83ab8-34e6-4e7d-981f-9dd54687680d service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-ce6d3612-ba67-48e2-9746-c4739dd70f70 req-8cf83ab8-34e6-4e7d-981f-9dd54687680d service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:19:00 user nova-compute[72904]: WARNING nova.compute.manager [req-ce6d3612-ba67-48e2-9746-c4739dd70f70 req-8cf83ab8-34e6-4e7d-981f-9dd54687680d service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state active and task_state rescuing.
Aug 27 05:19:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance destroyed successfully.
Aug 27 05:19:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Attempting a stable device rescue
Aug 27 05:19:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72904) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 27 05:19:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:19:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Creating image(s)
Aug 27 05:19:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "/opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "/opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "ad3359466a1bcd1b9a057d28e5bb8be60eb247fc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "ad3359466a1bcd1b9a057d28e5bb8be60eb247fc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.part --force-share --output=json" returned: 0 in 0.231s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-aedae05d-bc1b-4051-b2fa-18016b5ab549 req-77da71f8-4978-42c7-ace2-101eefcf66b1 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-aedae05d-bc1b-4051-b2fa-18016b5ab549 req-77da71f8-4978-42c7-ace2-101eefcf66b1 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-aedae05d-bc1b-4051-b2fa-18016b5ab549 req-77da71f8-4978-42c7-ace2-101eefcf66b1 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-aedae05d-bc1b-4051-b2fa-18016b5ab549 req-77da71f8-4978-42c7-ace2-101eefcf66b1 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-aedae05d-bc1b-4051-b2fa-18016b5ab549 req-77da71f8-4978-42c7-ace2-101eefcf66b1 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:19:02 user nova-compute[72904]: WARNING nova.compute.manager [req-aedae05d-bc1b-4051-b2fa-18016b5ab549 req-77da71f8-4978-42c7-ace2-101eefcf66b1 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state active and task_state rescuing.
Aug 27 05:19:02 user nova-compute[72904]: DEBUG nova.virt.images [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] 7e2748dc-97c5-4a5d-aec1-80318a1ccfd9 was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:19:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.part /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.part /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.converted" returned: 0 in 0.513s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "ad3359466a1bcd1b9a057d28e5bb8be60eb247fc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.242s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "ad3359466a1bcd1b9a057d28e5bb8be60eb247fc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "ad3359466a1bcd1b9a057d28e5bb8be60eb247fc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc --force-share --output=json" returned: 0 in 0.212s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc,backing_fmt=raw /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc,backing_fmt=raw /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue" returned: 0 in 0.481s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "ad3359466a1bcd1b9a057d28e5bb8be60eb247fc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.701s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'migration_context' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<63df90c8-8277-4fae-8fd0-37d748101579> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Start _get_guest_xml network_info=[{"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "vif_mac": "fa:16:3e:06:f1:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7e2748dc-97c5-4a5d-aec1-80318a1ccfd9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9f8c086d-be10-4093-8a04-e58a40ef4ccc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tExwZPHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '63df90c8-8277-4fae-8fd0-37d748101579', 'attached_at': '', 'detached_at': '', 'volume_id': 'd22c3bb2-4feb-42f0-ad6b-3b0fdff93b28', 'serial': 'd22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'resources' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<63df90c8-8277-4fae-8fd0-37d748101579> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'numa_topology' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<63df90c8-8277-4fae-8fd0-37d748101579> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:19:04 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:19:04 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<63df90c8-8277-4fae-8fd0-37d748101579> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tExwZPHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:19:04 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:19:04 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:19:04 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a0eee-4abb-4341-adb8-942e4d9cc395]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tExwZPHg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 27 05:19:04 user nova-compute[72904]: node.name = iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28
Aug 27 05:19:04 user nova-compute[72904]: node.tpgt = -1
Aug 27 05:19:04 user nova-compute[72904]: node.startup = automatic
Aug 27 05:19:04 user nova-compute[72904]: node.leading_login = No
Aug 27 05:19:04 user nova-compute[72904]: iface.iscsi_ifacename = default
Aug 27 05:19:04 user nova-compute[72904]: iface.net_ifacename = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.ipaddress = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.prefix_len = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.hwaddress = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.transport_name = tcp
Aug 27 05:19:04 user nova-compute[72904]: iface.initiatorname = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.state = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.vlan_id = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.vlan_priority = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.vlan_state = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.iface_num = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.mtu = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.port = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.bootproto = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.subnet_mask = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.gateway = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_alt_client_id_state = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_alt_client_id = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_dns = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_learn_iqn = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_req_vendor_id_state = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_vendor_id_state = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_vendor_id = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.dhcp_slp_da = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.fragmentation = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.gratuitous_arp = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.incoming_forwarding = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.tos_state = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.tos = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.ttl = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.delayed_ack = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.tcp_nagle = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.tcp_wsf_state = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.tcp_wsf = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.tcp_timer_scale = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.tcp_timestamp = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.redirect = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.def_task_mgmt_timeout = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.header_digest = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.data_digest = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.immediate_data = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.initial_r2t = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.data_seq_inorder = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.data_pdu_inorder = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.erl = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.max_receive_data_len = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.first_burst_len = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.max_outstanding_r2t = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.max_burst_len = 0
Aug 27 05:19:04 user nova-compute[72904]: iface.chap_auth = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.bidi_chap = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.strict_login_compliance = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.discovery_auth = <empty>
Aug 27 05:19:04 user nova-compute[72904]: iface.discovery_logout = <empty>
Aug 27 05:19:04 user nova-compute[72904]: node.discovery_address = <empty>
Aug 27 05:19:04 user nova-compute[72904]: node.discovery_port = 0
Aug 27 05:19:04 user nova-compute[72904]: node.discovery_type = static
Aug 27 05:19:04 user nova-compute[72904]: node.session.initial_cmdsn = 0
Aug 27 05:19:04 user nova-compute[72904]: node.session.initial_login_retry_max = 8
Aug 27 05:19:04 user nova-compute[72904]: node.session.xmit_thread_priority = -20
Aug 27 05:19:04 user nova-compute[72904]: node.session.cmds_max = 128
Aug 27 05:19:04 user nova-compute[72904]: node.session.queue_depth = 32
Aug 27 05:19:04 user nova-compute[72904]: node.session.nr_sessions = 1
Aug 27 05:19:04 user nova-compute[72904]: node.session.auth.authmethod = CHAP
Aug 27 05:19:04 user nova-compute[72904]: node.session.auth.username = tExwZPHg
Aug 27 05:19:04 user nova-compute[72904]: node.session.auth.password = ***
Aug 27 05:19:04 user nova-compute[72904]: node.session.auth.username_in = <empty>
Aug 27 05:19:04 user nova-compute[72904]: node.session.auth.password_in = <empty>
Aug 27 05:19:04 user nova-compute[72904]: node.session.auth.chap_algs = MD5
Aug 27 05:19:04 user nova-compute[72904]: node.session.timeo.replacement_timeout = 120
Aug 27 05:19:04 user nova-compute[72904]: node.session.err_timeo.abort_timeout = 15
Aug 27 05:19:04 user nova-compute[72904]: node.session.err_timeo.lu_reset_timeout = 30
Aug 27 05:19:04 user nova-compute[72904]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 27 05:19:04 user nova-compute[72904]: node.session.err_timeo.host_reset_timeout = 60
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.FastAbort = Yes
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.InitialR2T = No
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.ImmediateData = Yes
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.FirstBurstLength = 262144
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.MaxBurstLength = 16776192
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.DefaultTime2Retain = 0
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.DefaultTime2Wait = 2
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.MaxConnections = 1
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 27 05:19:04 user nova-compute[72904]: node.session.iscsi.ERL = 0
Aug 27 05:19:04 user nova-compute[72904]: node.session.scan = manual
Aug 27 05:19:04 user nova-compute[72904]: node.session.reopen_max = 0
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].address = 172.16.0.220
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].port = 3260
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].startup = manual
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].tcp.window_size = 524288
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].tcp.type_of_service = 0
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].timeo.logout_timeout = 15
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].timeo.login_timeout = 15
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].timeo.auth_timeout = 45
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].timeo.noop_out_interval = 5
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].timeo.noop_out_timeout = 5
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].iscsi.HeaderDigest = None
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].iscsi.DataDigest = None
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].iscsi.IFMarker = No
Aug 27 05:19:04 user nova-compute[72904]: node.conn[0].iscsi.OFMarker = No
Aug 27 05:19:04 user nova-compute[72904]: # END RECORD
Aug 27 05:19:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc1a3ee-6935-4fe7-864f-6872143aad87]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43ad55d-aae2-424b-a285-c97875eec2b4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tExwZPHg {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tExwZPHg" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb6522-5587-4129-80c8-6207f2ad8293]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tExwZPHg'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deb79fa-090a-4807-95f9-d8b218826afd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec120dc-0269-4d76-8878-a4e6613b89b6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:04 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] HCTL ('37', '0', '0', 0) found on session 39 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8548a01c-42b2-4475-98e4-d6a737c9f69d]: (4, ('0 0 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Searching for a device in session 39 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tExwZPHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.162s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== connect_volume: return (163ms) {'type': 'block', 'scsi_wwn': '26138306436616633', 'path': '/dev/sdf'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138306436616633', 'path': '/dev/sdf'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777426695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777426695',id=34,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-f237q405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:17:40Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=63df90c8-8277-4fae-8fd0-37d748101579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "vif_mac": "fa:16:3e:06:f1:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "vif_mac": "fa:16:3e:06:f1:54"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'pci_devices' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.objects.base [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Object Instance<63df90c8-8277-4fae-8fd0-37d748101579> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:19:04 user nova-compute[72904]:   <uuid>63df90c8-8277-4fae-8fd0-37d748101579</uuid>
Aug 27 05:19:04 user nova-compute[72904]:   <name>instance-00000022</name>
Aug 27 05:19:04 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:19:04 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:19:04 user nova-compute[72904]:   <metadata>
Aug 27 05:19:04 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:19:04 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:19:04 user nova-compute[72904]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1777426695</nova:name>
Aug 27 05:19:04 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:19:04</nova:creationTime>
Aug 27 05:19:04 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:19:04 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:19:04 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:19:04 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:19:04 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:19:04 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:19:04 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:19:04 user nova-compute[72904]:       <nova:owner>
Aug 27 05:19:04 user nova-compute[72904]:         <nova:user uuid="f4bbded3a71e4d6196d83c1fa5e7a868">tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member</nova:user>
Aug 27 05:19:04 user nova-compute[72904]:         <nova:project uuid="da9ae29302d54f8aa82e6c51bbfba65d">tempest-ServerBootFromVolumeStableRescueTest-1493340065</nova:project>
Aug 27 05:19:04 user nova-compute[72904]:       </nova:owner>
Aug 27 05:19:04 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:19:04 user nova-compute[72904]:       <nova:ports>
Aug 27 05:19:04 user nova-compute[72904]:         <nova:port uuid="2ca4ef45-c505-4a43-b318-6ddd3518593f">
Aug 27 05:19:04 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:19:04 user nova-compute[72904]:         </nova:port>
Aug 27 05:19:04 user nova-compute[72904]:       </nova:ports>
Aug 27 05:19:04 user nova-compute[72904]:     </nova:instance>
Aug 27 05:19:04 user nova-compute[72904]:   </metadata>
Aug 27 05:19:04 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:19:04 user nova-compute[72904]:     <system>
Aug 27 05:19:04 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:19:04 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:19:04 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:19:04 user nova-compute[72904]:       <entry name="serial">63df90c8-8277-4fae-8fd0-37d748101579</entry>
Aug 27 05:19:04 user nova-compute[72904]:       <entry name="uuid">63df90c8-8277-4fae-8fd0-37d748101579</entry>
Aug 27 05:19:04 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:19:04 user nova-compute[72904]:     </system>
Aug 27 05:19:04 user nova-compute[72904]:   </sysinfo>
Aug 27 05:19:04 user nova-compute[72904]:   <os>
Aug 27 05:19:04 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:19:04 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:19:04 user nova-compute[72904]:   </os>
Aug 27 05:19:04 user nova-compute[72904]:   <features>
Aug 27 05:19:04 user nova-compute[72904]:     <acpi/>
Aug 27 05:19:04 user nova-compute[72904]:     <apic/>
Aug 27 05:19:04 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:19:04 user nova-compute[72904]:   </features>
Aug 27 05:19:04 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:19:04 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:19:04 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:19:04 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:19:04 user nova-compute[72904]:   </clock>
Aug 27 05:19:04 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:19:04 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:19:04 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:19:04 user nova-compute[72904]:   </cpu>
Aug 27 05:19:04 user nova-compute[72904]:   <devices>
Aug 27 05:19:04 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:19:04 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:19:04 user nova-compute[72904]:       <source dev="/dev/sdf"/>
Aug 27 05:19:04 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:19:04 user nova-compute[72904]:       <serial>d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28</serial>
Aug 27 05:19:04 user nova-compute[72904]:     </disk>
Aug 27 05:19:04 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:19:04 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:19:04 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue"/>
Aug 27 05:19:04 user nova-compute[72904]:       <target dev="vdb" bus="virtio"/>
Aug 27 05:19:04 user nova-compute[72904]:       <boot order="1"/>
Aug 27 05:19:04 user nova-compute[72904]:     </disk>
Aug 27 05:19:04 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:19:04 user nova-compute[72904]:       <mac address="fa:16:3e:06:f1:54"/>
Aug 27 05:19:04 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:19:04 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:19:04 user nova-compute[72904]:       <target dev="tap2ca4ef45-c5"/>
Aug 27 05:19:04 user nova-compute[72904]:     </interface>
Aug 27 05:19:04 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:19:04 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/console.log" append="off"/>
Aug 27 05:19:04 user nova-compute[72904]:     </serial>
Aug 27 05:19:04 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:19:04 user nova-compute[72904]:     <video>
Aug 27 05:19:04 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:19:04 user nova-compute[72904]:     </video>
Aug 27 05:19:04 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:19:04 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:19:04 user nova-compute[72904]:     </rng>
Aug 27 05:19:04 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:19:04 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:19:04 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:19:04 user nova-compute[72904]:     </memballoon>
Aug 27 05:19:04 user nova-compute[72904]:   </devices>
Aug 27 05:19:04 user nova-compute[72904]: </domain>
Aug 27 05:19:04 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:19:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance destroyed successfully.
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:19:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] No VIF found with MAC fa:16:3e:06:f1:54, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-5984f589-a7a7-459d-84ba-e7b3901d99fb req-ac333035-2769-48d1-be46-ed690d78db79 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5984f589-a7a7-459d-84ba-e7b3901d99fb req-ac333035-2769-48d1-be46-ed690d78db79 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5984f589-a7a7-459d-84ba-e7b3901d99fb req-ac333035-2769-48d1-be46-ed690d78db79 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5984f589-a7a7-459d-84ba-e7b3901d99fb req-ac333035-2769-48d1-be46-ed690d78db79 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-5984f589-a7a7-459d-84ba-e7b3901d99fb req-ac333035-2769-48d1-be46-ed690d78db79 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:19:06 user nova-compute[72904]: WARNING nova.compute.manager [req-5984f589-a7a7-459d-84ba-e7b3901d99fb req-ac333035-2769-48d1-be46-ed690d78db79 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state active and task_state rescuing.
Aug 27 05:19:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:07 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113532.4147093, 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:19:07 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] VM Stopped (Lifecycle Event)
Aug 27 05:19:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1872422d-72c5-434f-be15-6a8a3073ec77 None None] [instance: 6c4f94ac-01ca-4028-a5d6-f3535edaaa7a] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:19:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 63df90c8-8277-4fae-8fd0-37d748101579 due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113548.3987765, 63df90c8-8277-4fae-8fd0-37d748101579 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:19:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] VM Resumed (Lifecycle Event)
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b0361633-2c3d-499f-8fca-937f4f4cd05a tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-9f9a5587-67a9-4a2a-af70-10603649d915 req-2b6a5704-5bc7-4915-8b8e-2885426734e0 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9f9a5587-67a9-4a2a-af70-10603649d915 req-2b6a5704-5bc7-4915-8b8e-2885426734e0 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9f9a5587-67a9-4a2a-af70-10603649d915 req-2b6a5704-5bc7-4915-8b8e-2885426734e0 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9f9a5587-67a9-4a2a-af70-10603649d915 req-2b6a5704-5bc7-4915-8b8e-2885426734e0 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-9f9a5587-67a9-4a2a-af70-10603649d915 req-2b6a5704-5bc7-4915-8b8e-2885426734e0 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:19:08 user nova-compute[72904]: WARNING nova.compute.manager [req-9f9a5587-67a9-4a2a-af70-10603649d915 req-2b6a5704-5bc7-4915-8b8e-2885426734e0 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state active and task_state rescuing.
Aug 27 05:19:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113548.409336, 63df90c8-8277-4fae-8fd0-37d748101579 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:19:08 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] VM Started (Lifecycle Event)
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:19:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:19:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received event network-changed-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:19:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Refreshing instance network info cache due to event network-changed-69c64a7d-7c60-4779-a59d-df6a50f043c7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:19:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] Acquiring lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:19:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] Acquired lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:19:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Refreshing network info cache for port 69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:19:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updated VIF entry in instance network info cache for port 69c64a7d-7c60-4779-a59d-df6a50f043c7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:19:30 user nova-compute[72904]: DEBUG nova.network.neutron [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating instance_info_cache with network_info: [{"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:19:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-66a05425-c565-4218-b800-e4505d5cab70 req-6c2968eb-ed7b-4b59-9a8b-62816498a737 service nova] Releasing lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:19:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:19:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing instance network info cache due to event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] Acquiring lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] Acquired lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:34 user nova-compute[72904]: INFO nova.compute.manager [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Detaching volume 670d66ae-d874-429a-a940-1ccb80917cb6
Aug 27 05:19:34 user nova-compute[72904]: INFO nova.virt.block_device [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Attempting to driver detach volume 670d66ae-d874-429a-a940-1ccb80917cb6 from mountpoint /dev/vdb
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Attempting to detach device vdb from instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:19:34 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:19:34 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:19:34 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:19:34 user nova-compute[72904]:   <serial>670d66ae-d874-429a-a940-1ccb80917cb6</serial>
Aug 27 05:19:34 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:19:34 user nova-compute[72904]: </disk>
Aug 27 05:19:34 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:19:34 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully detached device vdb from instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 from the persistent domain config.
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:19:34 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:19:34 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:19:34 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:19:34 user nova-compute[72904]:   <serial>670d66ae-d874-429a-a940-1ccb80917cb6</serial>
Aug 27 05:19:34 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:19:34 user nova-compute[72904]: </disk>
Aug 27 05:19:34 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updated VIF entry in instance network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6b0123ed-0550-4009-9bbb-0449dc018774 req-17d9ddf3-f1ab-485b-ac20-c3edc22e6e85 service nova] Releasing lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113574.8519301, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:19:34 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully detached device vdb from instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 from the live domain config.
Aug 27 05:19:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jOIhgCHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:19:34 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8578422-cf49-4389-84a2-49ab569de583]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894c5c0-4d1e-45f0-99cd-52ac29a5513e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7e8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:19:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d525e3-5087-467b-aa0e-c77363057465]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adc34f0-ef20-4153-95b7-9615397a2da6]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed910a6-2b37-4352-9817-7a31fddb4ab0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba16bf1-b2db-42aa-bace-5a3d1e320070]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e924149-8d5d-4ec8-a642-0d58665d3e9c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3da69-e2e0-4abc-b7b5-314e0c72892f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260]
Aug 27 05:19:35 user nova-compute[72904]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6, portal: 172.16.0.220,3260] successful.
Aug 27 05:19:35 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:670d66ae-d874-429a-a940-1ccb80917cb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5f6c6a-7355-4222-928d-8001c0ec0792]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] <== disconnect_volume: return (397ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing instance network info cache due to event network-changed-cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] Acquiring lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] Acquired lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Refreshing network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'flavor' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c7cc972f-9459-4abf-b757-d06148c051ea tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.998s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:36 user nova-compute[72904]: INFO nova.compute.manager [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attaching volume 0695d4e5-bc9b-497a-8ffe-52db90fe4da1 to /dev/vdb
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG os_brick.utils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb908c3-dad6-4b1c-8366-8631019227f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[591e6169-b95f-4411-88d7-5f97b37a21c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updated VIF entry in instance network info cache for port cc57cb58-ff4a-41a2-a902-9691bd2c9217. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [{"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f512c-4055-4e42-9fc8-a94e3b58b002]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b381f6be-9d6f-45bc-9ca6-7f7e46ccc859]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5320d995-c996-4ddf-98a7-77b854c762ea req-f5bbad30-9be0-42ac-998e-535950bda6ac service nova] Releasing lock "refresh_cache-6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:19:36 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1659e86-856c-4ac0-a2a7-9043008e78d8]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG os_brick.utils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating existing volume attachment record: f27e07f8-eeb1-47bb-ac49-713ecba4419f {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:19:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7283MB free_disk=25.055557250976562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 63df90c8-8277-4fae-8fd0-37d748101579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:19:37 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:19:38 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:19:38 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:19:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:19:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.743s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [{"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-19a548f0-90c2-47bb-8a68-7a788d7d736b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:19:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:19:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wICiAvMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:19:48 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:19:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:19:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:19:48 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:19:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:19:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:19:48 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:19:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5c1b68-49d5-4b25-8273-2a4dd2fe724c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:19:49 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[85156701-8623-4c3f-ac11-ceefa3832177]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1] added
Aug 27 05:19:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5399fd-64fd-4531-8490-92ce1aa5c0e2]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1a11a6-e9ad-4861-b9f2-ae836549762b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wICiAvMq {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wICiAvMq" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e9049f-44c1-4066-9cfd-ff4a12134d36]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wICiAvMq'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0f2cb1-972c-48e3-86f4-21e8ecf19183]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0136a2-a1ac-4580-8291-e7d36100464e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854a719-7202-4cd0-b9b2-a51bba172752]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260]
Aug 27 05:19:49 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260] successful.
Aug 27 05:19:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1a543-874c-4ff2-bc34-b544f2bf2d3e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee483a8-b446-4651-a680-2f7c717ec6bd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:19:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e38759-c94b-47b2-9c6a-d71f0a427b8c]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wICiAvMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:19:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23935336266333135', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935336266333135', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:19:50 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:19:50 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:19:50 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:19:50 user nova-compute[72904]:   <serial>0695d4e5-bc9b-497a-8ffe-52db90fe4da1</serial>
Aug 27 05:19:50 user nova-compute[72904]: </disk>
Aug 27 05:19:50 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No VIF found with MAC fa:16:3e:c7:0a:42, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:19:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d96eba8c-9762-48d5-9932-490856a86191 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.595s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:19:51 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:19:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:19:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:19:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:00 user nova-compute[72904]: INFO nova.compute.manager [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Unshelving
Aug 27 05:20:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'pci_requests' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'numa_topology' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:01 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:20:01 user nova-compute[72904]: INFO nova.compute.claims [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Claim successful on node user
Aug 27 05:20:01 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:20:01 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:20:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:01 user nova-compute[72904]: INFO nova.network.neutron [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating port a31f90c2-aff5-4bb0-9c12-89e8ecd30797 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 05:20:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquired lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing instance network info cache due to event network-changed-a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] Acquiring lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Releasing lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:20:02 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Creating image(s)
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'trusted_certs' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] Acquired lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.network.neutron [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Refreshing network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG nova.objects.base [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<103ea467-b0be-4221-81d4-ef2bbbfddc88> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "14ce9873b759e0455fea2ede6fc48aa72c0fee1b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "14ce9873b759e0455fea2ede6fc48aa72c0fee1b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.part --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.part --force-share --output=json" returned: 0 in 0.201s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG nova.virt.images [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] 361a8c5f-fe29-43ba-864f-45eab12a8b29 was qcow2, converting to raw {{(pid=72904) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG nova.privsep.utils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72904) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.part /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.converted {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG nova.network.neutron [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updated VIF entry in instance network info cache for port a31f90c2-aff5-4bb0-9c12-89e8ecd30797. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG nova.network.neutron [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8275f5fd-daec-48b4-9fc1-3bcc1602ec56 req-f92076f0-7fc3-466a-92ac-bc27e4c389cf service nova] Releasing lock "refresh_cache-103ea467-b0be-4221-81d4-ef2bbbfddc88" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.part /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.converted" returned: 0 in 0.474s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.converted --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "14ce9873b759e0455fea2ede6fc48aa72c0fee1b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.080s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b --force-share --output=json" returned: 0 in 0.235s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "14ce9873b759e0455fea2ede6fc48aa72c0fee1b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "14ce9873b759e0455fea2ede6fc48aa72c0fee1b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b --force-share --output=json" returned: 0 in 0.243s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b,backing_fmt=raw /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b,backing_fmt=raw /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk 1073741824" returned: 0 in 0.059s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "14ce9873b759e0455fea2ede6fc48aa72c0fee1b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b --force-share --output=json" returned: 0 in 0.235s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'migration_context' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG nova.objects.base [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<103ea467-b0be-4221-81d4-ef2bbbfddc88> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:20:05 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Rebasing disk image.
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.204s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 -F raw /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 -F raw /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk" returned: 0 in 2.101s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Ensure instance console log exists: /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Start _get_guest_xml network_info=[{"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a507d87e4c37756ef87ba14c24932b7f',container_format='bare',created_at=2023-08-27T05:18:07Z,direct_url=<?>,disk_format='qcow2',id=361a8c5f-fe29-43ba-864f-45eab12a8b29,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1446970509-shelved',owner='0fc9180eede040eaa688e81896d5c3c4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T05:18:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:20:08 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:08 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a507d87e4c37756ef87ba14c24932b7f',container_format='bare',created_at=2023-08-27T05:18:07Z,direct_url=<?>,disk_format='qcow2',id=361a8c5f-fe29-43ba-864f-45eab12a8b29,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1446970509-shelved',owner='0fc9180eede040eaa688e81896d5c3c4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-27T05:18:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'vcpu_model' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.objects.base [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<103ea467-b0be-4221-81d4-ef2bbbfddc88> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1446970509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1446970509',id=32,image_ref='361a8c5f-fe29-43ba-864f-45eab12a8b29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-989204785',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:16:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-ib4vtnbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member',shelved_at='2023-08-27T05:18:11.518743',shelved_host='user',shelved_image_id='361a8c5f-fe29-43ba-864f-45eab12a8b29'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=103ea467-b0be-4221-81d4-ef2bbbfddc88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'pci_devices' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.objects.base [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Object Instance<103ea467-b0be-4221-81d4-ef2bbbfddc88> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:20:08 user nova-compute[72904]:   <uuid>103ea467-b0be-4221-81d4-ef2bbbfddc88</uuid>
Aug 27 05:20:08 user nova-compute[72904]:   <name>instance-00000020</name>
Aug 27 05:20:08 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:20:08 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:20:08 user nova-compute[72904]:   <metadata>
Aug 27 05:20:08 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:20:08 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:20:08 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1446970509</nova:name>
Aug 27 05:20:08 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:20:08</nova:creationTime>
Aug 27 05:20:08 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:20:08 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:20:08 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:20:08 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:20:08 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:20:08 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:20:08 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:20:08 user nova-compute[72904]:       <nova:owner>
Aug 27 05:20:08 user nova-compute[72904]:         <nova:user uuid="bd521a1e127f496fa4e7865cfedf106f">tempest-AttachVolumeShelveTestJSON-1010055172-project-member</nova:user>
Aug 27 05:20:08 user nova-compute[72904]:         <nova:project uuid="0fc9180eede040eaa688e81896d5c3c4">tempest-AttachVolumeShelveTestJSON-1010055172</nova:project>
Aug 27 05:20:08 user nova-compute[72904]:       </nova:owner>
Aug 27 05:20:08 user nova-compute[72904]:       <nova:root type="image" uuid="361a8c5f-fe29-43ba-864f-45eab12a8b29"/>
Aug 27 05:20:08 user nova-compute[72904]:       <nova:ports>
Aug 27 05:20:08 user nova-compute[72904]:         <nova:port uuid="a31f90c2-aff5-4bb0-9c12-89e8ecd30797">
Aug 27 05:20:08 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 05:20:08 user nova-compute[72904]:         </nova:port>
Aug 27 05:20:08 user nova-compute[72904]:       </nova:ports>
Aug 27 05:20:08 user nova-compute[72904]:     </nova:instance>
Aug 27 05:20:08 user nova-compute[72904]:   </metadata>
Aug 27 05:20:08 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:20:08 user nova-compute[72904]:     <system>
Aug 27 05:20:08 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:20:08 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:20:08 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:20:08 user nova-compute[72904]:       <entry name="serial">103ea467-b0be-4221-81d4-ef2bbbfddc88</entry>
Aug 27 05:20:08 user nova-compute[72904]:       <entry name="uuid">103ea467-b0be-4221-81d4-ef2bbbfddc88</entry>
Aug 27 05:20:08 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:20:08 user nova-compute[72904]:     </system>
Aug 27 05:20:08 user nova-compute[72904]:   </sysinfo>
Aug 27 05:20:08 user nova-compute[72904]:   <os>
Aug 27 05:20:08 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:20:08 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:20:08 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:20:08 user nova-compute[72904]:   </os>
Aug 27 05:20:08 user nova-compute[72904]:   <features>
Aug 27 05:20:08 user nova-compute[72904]:     <acpi/>
Aug 27 05:20:08 user nova-compute[72904]:     <apic/>
Aug 27 05:20:08 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:20:08 user nova-compute[72904]:   </features>
Aug 27 05:20:08 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:20:08 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:20:08 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:20:08 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:20:08 user nova-compute[72904]:   </clock>
Aug 27 05:20:08 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:20:08 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:20:08 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:20:08 user nova-compute[72904]:   </cpu>
Aug 27 05:20:08 user nova-compute[72904]:   <devices>
Aug 27 05:20:08 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:20:08 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:20:08 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk"/>
Aug 27 05:20:08 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:20:08 user nova-compute[72904]:     </disk>
Aug 27 05:20:08 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:20:08 user nova-compute[72904]:       <mac address="fa:16:3e:b6:fe:dc"/>
Aug 27 05:20:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:20:08 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:20:08 user nova-compute[72904]:       <target dev="tapa31f90c2-af"/>
Aug 27 05:20:08 user nova-compute[72904]:     </interface>
Aug 27 05:20:08 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:20:08 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/console.log" append="off"/>
Aug 27 05:20:08 user nova-compute[72904]:     </serial>
Aug 27 05:20:08 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:20:08 user nova-compute[72904]:     <video>
Aug 27 05:20:08 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:20:08 user nova-compute[72904]:     </video>
Aug 27 05:20:08 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:20:08 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:20:08 user nova-compute[72904]:     </rng>
Aug 27 05:20:08 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:20:08 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:20:08 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:20:08 user nova-compute[72904]:     </memballoon>
Aug 27 05:20:08 user nova-compute[72904]:   </devices>
Aug 27 05:20:08 user nova-compute[72904]: </domain>
Aug 27 05:20:08 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1446970509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1446970509',id=32,image_ref='361a8c5f-fe29-43ba-864f-45eab12a8b29',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-989204785',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:16:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-ib4vtnbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member',shelved_at='2023-08-27T05:18:11.518743',shelved_host='user',shelved_image_id='361a8c5f-fe29-43ba-864f-45eab12a8b29'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:20:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=103ea467-b0be-4221-81d4-ef2bbbfddc88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG os_vif [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa31f90c2-af, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa31f90c2-af, col_values=(('external_ids', {'iface-id': 'a31f90c2-aff5-4bb0-9c12-89e8ecd30797', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:fe:dc', 'vm-uuid': '103ea467-b0be-4221-81d4-ef2bbbfddc88'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:08 user nova-compute[72904]: INFO os_vif [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af')
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:20:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] No VIF found with MAC fa:16:3e:b6:fe:dc, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-changed-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Refreshing instance network info cache due to event network-changed-4dc0a45b-3038-4833-87a3-0293e49b4522. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] Acquiring lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] Acquired lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG nova.network.neutron [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Refreshing network info cache for port 4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-c448e6b2-afd4-4325-bd07-9117f784ae42 req-11fb26a7-c4b1-4863-907d-9586eeca3315 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c448e6b2-afd4-4325-bd07-9117f784ae42 req-11fb26a7-c4b1-4863-907d-9586eeca3315 service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c448e6b2-afd4-4325-bd07-9117f784ae42 req-11fb26a7-c4b1-4863-907d-9586eeca3315 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c448e6b2-afd4-4325-bd07-9117f784ae42 req-11fb26a7-c4b1-4863-907d-9586eeca3315 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-c448e6b2-afd4-4325-bd07-9117f784ae42 req-11fb26a7-c4b1-4863-907d-9586eeca3315 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:10 user nova-compute[72904]: WARNING nova.compute.manager [req-c448e6b2-afd4-4325-bd07-9117f784ae42 req-11fb26a7-c4b1-4863-907d-9586eeca3315 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received unexpected event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 05:20:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updated VIF entry in instance network info cache for port 4dc0a45b-3038-4833-87a3-0293e49b4522. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c6076716-e5b6-4da2-b030-c6c48f3add56 req-2b966a2e-8d2c-46d7-b29a-a1506f0db57b service nova] Releasing lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Stashing vm_state: active {{(pid=72904) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-changed-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Refreshing instance network info cache due to event network-changed-13955c19-f1f4-466c-8e3a-5ccf423b2569. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] Acquiring lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] Acquired lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Refreshing network info cache for port 13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:20:11 user nova-compute[72904]: INFO nova.compute.claims [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Claim successful on node user
Aug 27 05:20:11 user nova-compute[72904]: INFO nova.compute.resource_tracker [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating resource usage from migration de8aaca6-034d-4420-b6bb-3ebba2a32677
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updated VIF entry in instance network info cache for port 13955c19-f1f4-466c-8e3a-5ccf423b2569. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25cb233c-999e-48f9-aedb-efae300c8a36 req-7e05f851-1580-42c4-bc42-8e237ed82104 service nova] Releasing lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113611.9679785, 103ea467-b0be-4221-81d4-ef2bbbfddc88 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:11 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] VM Resumed (Lifecycle Event)
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:20:11 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance spawned successfully.
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:12 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113611.9695969, 103ea467-b0be-4221-81d4-ef2bbbfddc88 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:12 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] VM Started (Lifecycle Event)
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:20:12 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-5da0d961-2dd4-4e59-9611-bbb8f2059ac6 req-4a19be9f-d852-4299-ab72-8c53a6b8bbf4 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5da0d961-2dd4-4e59-9611-bbb8f2059ac6 req-4a19be9f-d852-4299-ab72-8c53a6b8bbf4 service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5da0d961-2dd4-4e59-9611-bbb8f2059ac6 req-4a19be9f-d852-4299-ab72-8c53a6b8bbf4 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5da0d961-2dd4-4e59-9611-bbb8f2059ac6 req-4a19be9f-d852-4299-ab72-8c53a6b8bbf4 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-5da0d961-2dd4-4e59-9611-bbb8f2059ac6 req-4a19be9f-d852-4299-ab72-8c53a6b8bbf4 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:12 user nova-compute[72904]: WARNING nova.compute.manager [req-5da0d961-2dd4-4e59-9611-bbb8f2059ac6 req-4a19be9f-d852-4299-ab72-8c53a6b8bbf4 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received unexpected event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.609s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:12 user nova-compute[72904]: INFO nova.compute.manager [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Migrating
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.326s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:20:12 user nova-compute[72904]: INFO nova.compute.claims [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Claim successful on node user
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquired lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a2bf7435-6041-45ec-a214-d792fd6ca5ac tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.557s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Releasing lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:20:12 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:20:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Starting migrate_disk_and_power_off {{(pid=72904) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.policy [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aff961cb4ba4410fb4c7fba4ca907779', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508d0e5f51934ac9ad219665714ad215', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:20:13 user nova-compute[72904]: INFO nova.virt.block_device [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Booting with volume 81633978-c3ab-4770-98d8-e207b4f7992b at /dev/vda
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.utils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb29b33-79d1-427c-a1db-19238be18e33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[546c12c0-3446-49f6-829a-3473c13d5e51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60ae71a-2a6d-46aa-8336-1efec81312dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa1447e-190c-4237-ad8f-904f546bdb0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:20:13 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e8ef62-5e5f-4d87-b568-b2c422fcc132]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.utils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating existing volume attachment record: a5a8eaa7-9e58-4ca4-8f03-75ae43ee263e {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-d657d457-3611-4560-b142-0dcddd94b087 req-1e26643b-8d6c-4598-a44a-5dcade8ede2c service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-unplugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d657d457-3611-4560-b142-0dcddd94b087 req-1e26643b-8d6c-4598-a44a-5dcade8ede2c service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d657d457-3611-4560-b142-0dcddd94b087 req-1e26643b-8d6c-4598-a44a-5dcade8ede2c service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d657d457-3611-4560-b142-0dcddd94b087 req-1e26643b-8d6c-4598-a44a-5dcade8ede2c service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-d657d457-3611-4560-b142-0dcddd94b087 req-1e26643b-8d6c-4598-a44a-5dcade8ede2c service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-unplugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:13 user nova-compute[72904]: WARNING nova.compute.manager [req-d657d457-3611-4560-b142-0dcddd94b087 req-1e26643b-8d6c-4598-a44a-5dcade8ede2c service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received unexpected event network-vif-unplugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with vm_state active and task_state resize_migrating.
Aug 27 05:20:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance destroyed successfully.
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1439837580',display_name='tempest-ServerActionsTestOtherA-server-1439837580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1439837580',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-fq2wl9pq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:20:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=12da6d24-08c6-4b62-bef3-3dbc05b28020,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1837545107-network", "vif_mac": "fa:16:3e:ad:28:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1837545107-network", "vif_mac": "fa:16:3e:ad:28:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_vif [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13955c19-f1, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:20:13 user nova-compute[72904]: INFO os_vif [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1')
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:20:13 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[25556929-f567-491a-af4b-bdf8564828ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[484e97d4-7560-4990-a925-7bb119cc846c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7e8550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'): ({'sde'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Removing single pathed devices sde {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b962da-0be6-4c8f-890c-8c0ef4b3b47b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[54da650a-633f-497a-93d6-f6eca512d681]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flushing IO for device /dev/sde {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a6687e-88ca-4b4f-910b-a5c00c0bcc03]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f728a0-29cc-41d2-8159-c7475315b588]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06404ad-7483-4edd-b404-ba3696a5495c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Successfully created port: c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3094d8d8-9b64-426c-9473-03f9ff11edf9]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]
Aug 27 05:20:13 user nova-compute[72904]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.
Aug 27 05:20:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5b65ea-6bce-4ba0-8ff0-6d562b4491ab]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== disconnect_volume: return (360ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:20:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Successfully updated port: c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing instance network info cache due to event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:20:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Port 13955c19-f1f4-466c-8e3a-5ccf423b2569 binding to destination host user is already ACTIVE {{(pid=72904) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG nova.network.neutron [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance network_info: |[{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquired lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-1adc6449-b397-4bf9-9abd-b520029bd92c req-2e11107f-5162-45d2-8149-ea32af66dd83 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1adc6449-b397-4bf9-9abd-b520029bd92c req-2e11107f-5162-45d2-8149-ea32af66dd83 service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1adc6449-b397-4bf9-9abd-b520029bd92c req-2e11107f-5162-45d2-8149-ea32af66dd83 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1adc6449-b397-4bf9-9abd-b520029bd92c req-2e11107f-5162-45d2-8149-ea32af66dd83 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-1adc6449-b397-4bf9-9abd-b520029bd92c req-2e11107f-5162-45d2-8149-ea32af66dd83 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:15 user nova-compute[72904]: WARNING nova.compute.manager [req-1adc6449-b397-4bf9-9abd-b520029bd92c req-2e11107f-5162-45d2-8149-ea32af66dd83 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received unexpected event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with vm_state active and task_state resize_migrated.
Aug 27 05:20:16 user nova-compute[72904]: DEBUG nova.network.neutron [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updated VIF entry in instance network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG nova.network.neutron [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-abb198ba-4f7c-4658-a306-43d238decfc5 req-bec53fe6-32da-49b3-b575-3a12bbbc5335 service nova] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Releasing lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG os_brick.utils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3696c7-dc8e-4893-8aae-614b1d3f4be7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[78df2301-b5f7-4ce9-822e-d01a03068069]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c21c56e-9569-46cf-a62a-8fe80508d7aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a483ec-4dd2-42d5-a9a3-6e0781c6710e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:20:16 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:20:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7193d3-f74f-4b04-8c25-50faa155e963]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG os_brick.utils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:20:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:24 user nova-compute[72904]: INFO nova.compute.manager [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Terminating instance
Aug 27 05:20:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:20:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-2b25c4c8-928b-456d-8200-518a57efb76c req-3bccb37a-7058-4e26-95d4-0edf97a3b42b service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2b25c4c8-928b-456d-8200-518a57efb76c req-3bccb37a-7058-4e26-95d4-0edf97a3b42b service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2b25c4c8-928b-456d-8200-518a57efb76c req-3bccb37a-7058-4e26-95d4-0edf97a3b42b service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2b25c4c8-928b-456d-8200-518a57efb76c req-3bccb37a-7058-4e26-95d4-0edf97a3b42b service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-2b25c4c8-928b-456d-8200-518a57efb76c req-3bccb37a-7058-4e26-95d4-0edf97a3b42b service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-2b25c4c8-928b-456d-8200-518a57efb76c req-3bccb37a-7058-4e26-95d4-0edf97a3b42b service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Instance destroyed successfully.
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'resources' on Instance uuid 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:13:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-964941530',display_name='tempest-ServerRescueNegativeTestJSON-server-964941530',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-964941530',id=28,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCwGsbTWKclBmdJpysTtFepyuf/r32Xo/ACVhO6iycF8/M0FEO8SOaca+JxtvLJeqK29+Mqn/TLgD6cDUZJZuegZiX7Oh/SnEAFe/0bF69k9zC0QmLZ75dZPHWAlh9wvQ==',key_name='tempest-keypair-1522623289',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:15:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-yqjvoune',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:17:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='223d760d5f03408781a9241f98a5a6c8',uuid=6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "address": "fa:16:3e:f3:53:c0", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc57cb58-ff", "ovs_interfaceid": "cc57cb58-ff4a-41a2-a902-9691bd2c9217", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG os_vif [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc57cb58-ff, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: INFO os_vif [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:53:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc57cb58-ff4a-41a2-a902-9691bd2c9217,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc57cb58-ff')
Aug 27 05:20:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Deleting instance files /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049_del
Aug 27 05:20:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Deletion of /opt/stack/data/nova/instances/6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049_del complete
Aug 27 05:20:25 user nova-compute[72904]: INFO nova.compute.manager [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 27 05:20:25 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:20:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Creating image(s)
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Ensure instance console log exists: /opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Start _get_guest_xml network_info=[{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a5a8eaa7-9e58-4ca4-8f03-75ae43ee263e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2d438f2-0630-4fab-9eab-f00276a01949', 'attached_at': '', 'detached_at': '', 'volume_id': '81633978-c3ab-4770-98d8-e207b4f7992b', 'serial': '81633978-c3ab-4770-98d8-e207b4f7992b'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:20:26 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:26 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:20:26 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:20:26 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:20:26 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23f006c-ab46-4e77-9d51-ad9f7b3f236d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:20:26 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad226f7a-dc9f-49c4-a969-b63e7e097ed1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b] added
Aug 27 05:20:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[30009de6-cd01-4613-ae95-79f8c5bef384]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaab053-54ea-47cc-b0f5-631e0963d620]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKpCuJn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKpCuJn" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b88da4-3faa-407a-b1a4-ed69df47dc43]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwKpCuJn'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ecd3d6-26b5-48cb-93ab-c18129a9ca79]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-0fc73826-5e5d-4514-9861-6e60d9112296 req-e5ea6ad6-fa9c-473a-803d-0f44f81a686a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-deleted-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:26 user nova-compute[72904]: INFO nova.compute.manager [req-0fc73826-5e5d-4514-9861-6e60d9112296 req-e5ea6ad6-fa9c-473a-803d-0f44f81a686a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Neutron deleted interface cc57cb58-ff4a-41a2-a902-9691bd2c9217; detaching it from the instance and deleting it from the info cache
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-0fc73826-5e5d-4514-9861-6e60d9112296 req-e5ea6ad6-fa9c-473a-803d-0f44f81a686a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:26 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Took 1.22 seconds to deallocate network for instance.
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be0f53-84c7-438c-af3b-b2912766b914]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-0fc73826-5e5d-4514-9861-6e60d9112296 req-e5ea6ad6-fa9c-473a-803d-0f44f81a686a service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Detach interface failed, port_id=cc57cb58-ff4a-41a2-a902-9691bd2c9217, reason: Instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:20:26 user nova-compute[72904]: INFO nova.compute.manager [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Detaching volume 0695d4e5-bc9b-497a-8ffe-52db90fe4da1
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9172f34-c0a5-4600-bbe9-f0972e4961a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]
Aug 27 05:20:26 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.
Aug 27 05:20:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b2e8fc-ade7-4c99-be7e-872f0ba51dcd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:26 user nova-compute[72904]: INFO nova.virt.block_device [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attempting to driver detach volume 0695d4e5-bc9b-497a-8ffe-52db90fe4da1 from mountpoint /dev/vdb
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Attempting to detach device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:20:26 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:20:26 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:20:26 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:20:26 user nova-compute[72904]:   <serial>0695d4e5-bc9b-497a-8ffe-52db90fe4da1</serial>
Aug 27 05:20:26 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:20:26 user nova-compute[72904]: </disk>
Aug 27 05:20:26 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e65235-95c1-4bc3-851a-e7bf623a491b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:26 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:20:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config.
Aug 27 05:20:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:20:27 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:20:27 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:20:27 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:20:27 user nova-compute[72904]:   <serial>0695d4e5-bc9b-497a-8ffe-52db90fe4da1</serial>
Aug 27 05:20:27 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:20:27 user nova-compute[72904]: </disk>
Aug 27 05:20:27 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.033s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3734554c-47a9-4b53-9890-98ee4955ac0b]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:27 user nova-compute[72904]: WARNING nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state deleted and task_state None.
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:27 user nova-compute[72904]: WARNING nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state deleted and task_state None.
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:27 user nova-compute[72904]: WARNING nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state deleted and task_state None.
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:27 user nova-compute[72904]: WARNING nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-unplugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state deleted and task_state None.
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Acquiring lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] No waiting events found dispatching network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:27 user nova-compute[72904]: WARNING nova.compute.manager [req-8907c3ab-d989-413d-b0b0-647f6adc782b req-7f3d7178-2f35-47b9-91a5-24a01cc5129f service nova] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Received unexpected event network-vif-plugged-cc57cb58-ff4a-41a2-a902-9691bd2c9217 for instance with vm_state deleted and task_state None.
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113627.4851577, f88b1d96-56b7-4595-af27-50993d25d527 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:20:27 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config.
Aug 27 05:20:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:20:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wICiAvMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:20:27 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:20:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:20:27 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Deleted allocations for instance 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049
Aug 27 05:20:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f0b9efa0-217b-4588-9144-05719db9b738 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.986s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23237353533386630', 'path': '/dev/sde'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237353533386630', 'path': '/dev/sde'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.543s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[879fbeed-62c4-4507-8f56-d30529624b33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-877479218',display_name='tempest-TestShelveInstance-server-877479218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-877479218',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO/iPXTu/fu6ydtm7XM3fu0hQRmXBEu08sy3yMGf8dkOC9xCqtIt2kUGIRuyGp5myE1oRLwcSFevSSXAHPtWvdNz9GGnC0v+ntXMXJmNB4jHQzYQawwX8LWHb3RsKXA9Q==',key_name='tempest-TestShelveInstance-1274547691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='508d0e5f51934ac9ad219665714ad215',ramdisk_id='',reservation_id='r-lrjlnj1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-863084300',owner_user_name='tempest-TestShelveInstance-863084300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:20:13Z,user_data=None,user_id='aff961cb4ba4410fb4c7fba4ca907779',uuid=c2d438f2-0630-4fab-9eab-f00276a01949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converting VIF {"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'pci_devices' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:20:28 user nova-compute[72904]:   <uuid>c2d438f2-0630-4fab-9eab-f00276a01949</uuid>
Aug 27 05:20:28 user nova-compute[72904]:   <name>instance-00000025</name>
Aug 27 05:20:28 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:20:28 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:20:28 user nova-compute[72904]:   <metadata>
Aug 27 05:20:28 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:20:28 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:20:28 user nova-compute[72904]:       <nova:name>tempest-TestShelveInstance-server-877479218</nova:name>
Aug 27 05:20:28 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:20:26</nova:creationTime>
Aug 27 05:20:28 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:20:28 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:20:28 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:20:28 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:20:28 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:20:28 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:20:28 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:20:28 user nova-compute[72904]:       <nova:owner>
Aug 27 05:20:28 user nova-compute[72904]:         <nova:user uuid="aff961cb4ba4410fb4c7fba4ca907779">tempest-TestShelveInstance-863084300-project-member</nova:user>
Aug 27 05:20:28 user nova-compute[72904]:         <nova:project uuid="508d0e5f51934ac9ad219665714ad215">tempest-TestShelveInstance-863084300</nova:project>
Aug 27 05:20:28 user nova-compute[72904]:       </nova:owner>
Aug 27 05:20:28 user nova-compute[72904]:       <nova:ports>
Aug 27 05:20:28 user nova-compute[72904]:         <nova:port uuid="c83b0b06-36a4-4822-8922-8a36c443aa85">
Aug 27 05:20:28 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:20:28 user nova-compute[72904]:         </nova:port>
Aug 27 05:20:28 user nova-compute[72904]:       </nova:ports>
Aug 27 05:20:28 user nova-compute[72904]:     </nova:instance>
Aug 27 05:20:28 user nova-compute[72904]:   </metadata>
Aug 27 05:20:28 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:20:28 user nova-compute[72904]:     <system>
Aug 27 05:20:28 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:20:28 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:20:28 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:20:28 user nova-compute[72904]:       <entry name="serial">c2d438f2-0630-4fab-9eab-f00276a01949</entry>
Aug 27 05:20:28 user nova-compute[72904]:       <entry name="uuid">c2d438f2-0630-4fab-9eab-f00276a01949</entry>
Aug 27 05:20:28 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:20:28 user nova-compute[72904]:     </system>
Aug 27 05:20:28 user nova-compute[72904]:   </sysinfo>
Aug 27 05:20:28 user nova-compute[72904]:   <os>
Aug 27 05:20:28 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:20:28 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:20:28 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:20:28 user nova-compute[72904]:   </os>
Aug 27 05:20:28 user nova-compute[72904]:   <features>
Aug 27 05:20:28 user nova-compute[72904]:     <acpi/>
Aug 27 05:20:28 user nova-compute[72904]:     <apic/>
Aug 27 05:20:28 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:20:28 user nova-compute[72904]:   </features>
Aug 27 05:20:28 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:20:28 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:20:28 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:20:28 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:20:28 user nova-compute[72904]:   </clock>
Aug 27 05:20:28 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:20:28 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:20:28 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:20:28 user nova-compute[72904]:   </cpu>
Aug 27 05:20:28 user nova-compute[72904]:   <devices>
Aug 27 05:20:28 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:20:28 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:20:28 user nova-compute[72904]:       <source dev="/dev/sde"/>
Aug 27 05:20:28 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:20:28 user nova-compute[72904]:       <serial>81633978-c3ab-4770-98d8-e207b4f7992b</serial>
Aug 27 05:20:28 user nova-compute[72904]:     </disk>
Aug 27 05:20:28 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:20:28 user nova-compute[72904]:       <mac address="fa:16:3e:a2:d8:be"/>
Aug 27 05:20:28 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:20:28 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:20:28 user nova-compute[72904]:       <target dev="tapc83b0b06-36"/>
Aug 27 05:20:28 user nova-compute[72904]:     </interface>
Aug 27 05:20:28 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:20:28 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949/console.log" append="off"/>
Aug 27 05:20:28 user nova-compute[72904]:     </serial>
Aug 27 05:20:28 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:20:28 user nova-compute[72904]:     <video>
Aug 27 05:20:28 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:20:28 user nova-compute[72904]:     </video>
Aug 27 05:20:28 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:20:28 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:20:28 user nova-compute[72904]:     </rng>
Aug 27 05:20:28 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:20:28 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:20:28 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:20:28 user nova-compute[72904]:     </memballoon>
Aug 27 05:20:28 user nova-compute[72904]:   </devices>
Aug 27 05:20:28 user nova-compute[72904]: </domain>
Aug 27 05:20:28 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-877479218',display_name='tempest-TestShelveInstance-server-877479218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-877479218',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO/iPXTu/fu6ydtm7XM3fu0hQRmXBEu08sy3yMGf8dkOC9xCqtIt2kUGIRuyGp5myE1oRLwcSFevSSXAHPtWvdNz9GGnC0v+ntXMXJmNB4jHQzYQawwX8LWHb3RsKXA9Q==',key_name='tempest-TestShelveInstance-1274547691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='508d0e5f51934ac9ad219665714ad215',ramdisk_id='',reservation_id='r-lrjlnj1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-863084300',owner_user_name='tempest-TestShelveInstance-863084300-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:20:13Z,user_data=None,user_id='aff961cb4ba4410fb4c7fba4ca907779',uuid=c2d438f2-0630-4fab-9eab-f00276a01949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converting VIF {"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_vif [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a375ef8a-2183-4973-9833-d12a3cfcd7f0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 (non-flash)
Aug 27 05:20:28 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c54feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83b0b06-36, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc83b0b06-36, col_values=(('external_ids', {'iface-id': 'c83b0b06-36a4-4822-8922-8a36c443aa85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:d8:be', 'vm-uuid': 'c2d438f2-0630-4fab-9eab-f00276a01949'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:28 user nova-compute[72904]: INFO os_vif [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36')
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef07e4-f7ce-46a9-8dee-b842c7e68767]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[678a6a50-da0b-4909-9a2f-3fbac95b25d1]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7bb1c2-0e57-420e-9a43-81cdee1d788c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] No VIF found with MAC fa:16:3e:a2:d8:be, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efca609-22f0-4a7b-acb4-44c67cfb1029]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10cedf6-8903-4411-8d2f-fc3ed52ff42c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6640e732-946c-4c6e-9f81-b04cd41988a5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260]
Aug 27 05:20:28 user nova-compute[72904]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1, portal: 172.16.0.220,3260] successful.
Aug 27 05:20:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0695d4e5-bc9b-497a-8ffe-52db90fe4da1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ca393f-2a37-43a9-b0fb-ae563e8d9636]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== disconnect_volume: return (863ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113613.5978322, 12da6d24-08c6-4b62-bef3-3dbc05b28020 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:28 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] VM Stopped (Lifecycle Event)
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-be3ad309-fb18-4536-96da-94724e2bc976 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-be3ad309-fb18-4536-96da-94724e2bc976 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:28 user nova-compute[72904]: INFO nova.compute.manager [None req-be3ad309-fb18-4536-96da-94724e2bc976 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 05:20:29 user nova-compute[72904]: DEBUG nova.objects.instance [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-216754c0-e4d7-4d9f-b489-959588329d60 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.373s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-bf148e20-055f-4e56-9f19-2d2125b5f146 req-8b60981b-1cb0-435c-bcb4-0cfbde695ab7 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bf148e20-055f-4e56-9f19-2d2125b5f146 req-8b60981b-1cb0-435c-bcb4-0cfbde695ab7 service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bf148e20-055f-4e56-9f19-2d2125b5f146 req-8b60981b-1cb0-435c-bcb4-0cfbde695ab7 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bf148e20-055f-4e56-9f19-2d2125b5f146 req-8b60981b-1cb0-435c-bcb4-0cfbde695ab7 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-bf148e20-055f-4e56-9f19-2d2125b5f146 req-8b60981b-1cb0-435c-bcb4-0cfbde695ab7 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:29 user nova-compute[72904]: WARNING nova.compute.manager [req-bf148e20-055f-4e56-9f19-2d2125b5f146 req-8b60981b-1cb0-435c-bcb4-0cfbde695ab7 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received unexpected event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with vm_state building and task_state spawning.
Aug 27 05:20:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Starting finish_migration {{(pid=72904) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance directory exists: not creating {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 27 05:20:30 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Creating image(s)
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Ensure instance console log exists: /opt/stack/data/nova/instances/12da6d24-08c6-4b62-bef3-3dbc05b28020/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Start _get_guest_xml network_info=[{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1837545107-network", "vif_mac": "fa:16:3e:ad:28:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd02a5329-a0a2-4b2e-8ec9-7b1569f2d2f6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '12da6d24-08c6-4b62-bef3-3dbc05b28020', 'attached_at': '2023-08-27T05:20:30.000000', 'detached_at': '', 'volume_id': 'ea1cbb08-6b6b-42af-b6d5-54c76ce769d7', 'serial': 'ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:20:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:30 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:20:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:20:30 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:20:30 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e707865-15e1-49ac-a08b-b4939e5fa0e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:20:30 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bad1de-0e92-4196-ab08-b8856bafa185]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7] added
Aug 27 05:20:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b032d7f7-fc6d-41dc-b821-8e5e5839c235]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77498361-e3f2-4882-a05e-8e13780b2a30]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noNWRVwA {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noNWRVwA" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[289b6907-e0db-4636-b1e3-30d99f84f4ce]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'noNWRVwA'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d716c33-fd5e-47e8-8836-0cedfce8945a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[be405242-ee27-43aa-8e3e-224cde59b605]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04d78f4-966f-4955-b59d-9653156f9321]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]
Aug 27 05:20:30 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.
Aug 27 05:20:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65ef0a6-31f1-4c3c-9138-761d661cea94]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[45346120-22ef-4475-8a41-8037d3e62a16]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:30 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:20:30 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c82980-db39-49c2-9589-e2c6d96fddac]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:30 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113631.5961897, c2d438f2-0630-4fab-9eab-f00276a01949 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] VM Resumed (Lifecycle Event)
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:20:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance spawned successfully.
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:20:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113631.5964122, c2d438f2-0630-4fab-9eab-f00276a01949 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] VM Started (Lifecycle Event)
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23537316430616666', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537316430616666', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:20:31 user nova-compute[72904]: INFO nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:31 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1439837580',display_name='tempest-ServerActionsTestOtherA-server-1439837580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1439837580',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-fq2wl9pq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=12da6d24-08c6-4b62-bef3-3dbc05b28020,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1837545107-network", "vif_mac": "fa:16:3e:ad:28:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1837545107-network", "vif_mac": "fa:16:3e:ad:28:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:20:31 user nova-compute[72904]:   <uuid>12da6d24-08c6-4b62-bef3-3dbc05b28020</uuid>
Aug 27 05:20:31 user nova-compute[72904]:   <name>instance-00000024</name>
Aug 27 05:20:31 user nova-compute[72904]:   <memory>2097152</memory>
Aug 27 05:20:31 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:20:31 user nova-compute[72904]:   <metadata>
Aug 27 05:20:31 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:20:31 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:20:31 user nova-compute[72904]:       <nova:name>tempest-ServerActionsTestOtherA-server-1439837580</nova:name>
Aug 27 05:20:31 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:20:30</nova:creationTime>
Aug 27 05:20:31 user nova-compute[72904]:       <nova:flavor name="m1.small">
Aug 27 05:20:31 user nova-compute[72904]:         <nova:memory>2048</nova:memory>
Aug 27 05:20:31 user nova-compute[72904]:         <nova:disk>20</nova:disk>
Aug 27 05:20:31 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:20:31 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:20:31 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:20:31 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:20:31 user nova-compute[72904]:       <nova:owner>
Aug 27 05:20:31 user nova-compute[72904]:         <nova:user uuid="14df3bfebe7c43dca0a4ef2ee90f995b">tempest-ServerActionsTestOtherA-886850923-project-member</nova:user>
Aug 27 05:20:31 user nova-compute[72904]:         <nova:project uuid="a553916b16f8404ca042ad82b503e6c7">tempest-ServerActionsTestOtherA-886850923</nova:project>
Aug 27 05:20:31 user nova-compute[72904]:       </nova:owner>
Aug 27 05:20:31 user nova-compute[72904]:       <nova:ports>
Aug 27 05:20:31 user nova-compute[72904]:         <nova:port uuid="13955c19-f1f4-466c-8e3a-5ccf423b2569">
Aug 27 05:20:31 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:20:31 user nova-compute[72904]:         </nova:port>
Aug 27 05:20:31 user nova-compute[72904]:       </nova:ports>
Aug 27 05:20:31 user nova-compute[72904]:     </nova:instance>
Aug 27 05:20:31 user nova-compute[72904]:   </metadata>
Aug 27 05:20:31 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:20:31 user nova-compute[72904]:     <system>
Aug 27 05:20:31 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:20:31 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:20:31 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:20:31 user nova-compute[72904]:       <entry name="serial">12da6d24-08c6-4b62-bef3-3dbc05b28020</entry>
Aug 27 05:20:31 user nova-compute[72904]:       <entry name="uuid">12da6d24-08c6-4b62-bef3-3dbc05b28020</entry>
Aug 27 05:20:31 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:20:31 user nova-compute[72904]:     </system>
Aug 27 05:20:31 user nova-compute[72904]:   </sysinfo>
Aug 27 05:20:31 user nova-compute[72904]:   <os>
Aug 27 05:20:31 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:20:31 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:20:31 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:20:31 user nova-compute[72904]:   </os>
Aug 27 05:20:31 user nova-compute[72904]:   <features>
Aug 27 05:20:31 user nova-compute[72904]:     <acpi/>
Aug 27 05:20:31 user nova-compute[72904]:     <apic/>
Aug 27 05:20:31 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:20:31 user nova-compute[72904]:   </features>
Aug 27 05:20:31 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:20:31 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:20:31 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:20:31 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:20:31 user nova-compute[72904]:   </clock>
Aug 27 05:20:31 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:20:31 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:20:31 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:20:31 user nova-compute[72904]:   </cpu>
Aug 27 05:20:31 user nova-compute[72904]:   <devices>
Aug 27 05:20:31 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:20:31 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:20:31 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:20:31 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:20:31 user nova-compute[72904]:       <serial>ea1cbb08-6b6b-42af-b6d5-54c76ce769d7</serial>
Aug 27 05:20:31 user nova-compute[72904]:     </disk>
Aug 27 05:20:31 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:20:31 user nova-compute[72904]:       <mac address="fa:16:3e:ad:28:f1"/>
Aug 27 05:20:31 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:20:31 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:20:31 user nova-compute[72904]:       <target dev="tap13955c19-f1"/>
Aug 27 05:20:31 user nova-compute[72904]:     </interface>
Aug 27 05:20:31 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:20:31 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/12da6d24-08c6-4b62-bef3-3dbc05b28020/console.log" append="off"/>
Aug 27 05:20:31 user nova-compute[72904]:     </serial>
Aug 27 05:20:31 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:20:31 user nova-compute[72904]:     <video>
Aug 27 05:20:31 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:20:31 user nova-compute[72904]:     </video>
Aug 27 05:20:31 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:20:31 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:20:31 user nova-compute[72904]:     </rng>
Aug 27 05:20:31 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:20:31 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:20:31 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:20:31 user nova-compute[72904]:     </memballoon>
Aug 27 05:20:31 user nova-compute[72904]:   </devices>
Aug 27 05:20:31 user nova-compute[72904]: </domain>
Aug 27 05:20:31 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1439837580',display_name='tempest-ServerActionsTestOtherA-server-1439837580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1439837580',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-fq2wl9pq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=12da6d24-08c6-4b62-bef3-3dbc05b28020,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1837545107-network", "vif_mac": "fa:16:3e:ad:28:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1837545107-network", "vif_mac": "fa:16:3e:ad:28:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG os_vif [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:31 user nova-compute[72904]: WARNING nova.compute.manager [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received unexpected event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with vm_state building and task_state spawning.
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing instance network info cache due to event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] Acquiring lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] Acquired lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.network.neutron [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13955c19-f1, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13955c19-f1, col_values=(('external_ids', {'iface-id': '13955c19-f1f4-466c-8e3a-5ccf423b2569', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:28:f1', 'vm-uuid': '12da6d24-08c6-4b62-bef3-3dbc05b28020'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:31 user nova-compute[72904]: INFO os_vif [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1')
Aug 27 05:20:31 user nova-compute[72904]: INFO nova.compute.manager [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Took 20.02 seconds to build instance.
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b93d3748-a9d8-4463-8a25-d0b744f12d9f tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.155s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] No VIF found with MAC fa:16:3e:ad:28:f1, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:32 user nova-compute[72904]: INFO nova.compute.manager [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Detaching volume f490002a-8f4c-4a54-a1c7-f73dfd7351e7
Aug 27 05:20:32 user nova-compute[72904]: INFO nova.virt.block_device [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Attempting to driver detach volume f490002a-8f4c-4a54-a1c7-f73dfd7351e7 from mountpoint /dev/vdb
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Attempting to detach device vdb from instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:20:32 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:20:32 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:20:32 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:20:32 user nova-compute[72904]:   <serial>f490002a-8f4c-4a54-a1c7-f73dfd7351e7</serial>
Aug 27 05:20:32 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:20:32 user nova-compute[72904]: </disk>
Aug 27 05:20:32 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:20:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully detached device vdb from instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 from the persistent domain config.
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:20:32 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:20:32 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:20:32 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:20:32 user nova-compute[72904]:   <serial>f490002a-8f4c-4a54-a1c7-f73dfd7351e7</serial>
Aug 27 05:20:32 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:20:32 user nova-compute[72904]: </disk>
Aug 27 05:20:32 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.network.neutron [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updated VIF entry in instance network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.network.neutron [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60ce2db4-3a75-45c2-abbf-703edf39b090 req-940692f4-9d98-4030-b490-deeeb065673e service nova] Releasing lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113632.8955615, 7fe87c87-d6bf-4cee-a0f3-67b563122d18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:20:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully detached device vdb from instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 from the live domain config.
Aug 27 05:20:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzOLqHBY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:20:32 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3ca69-41c7-4bfd-93c4-db525ca1da5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8ac716-3a43-40bf-aa1f-d6e39f3916d9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:20:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:20:32 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:20:32 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919438c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:20:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b25757-905d-4343-9835-616bc12935d9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe2380a-5b74-44c5-b6d2-11f02e2cd020]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d6401d-cc2e-4525-a82c-726f14bda510]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c310ef21-1731-415c-9cf3-fc7765a5b5f9]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1881c0-0957-4cff-85c0-4b2bdb3a7b78]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[788a56d5-6d7d-4827-9aec-3de612d54ce7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260]
Aug 27 05:20:33 user nova-compute[72904]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7, portal: 172.16.0.220,3260] successful.
Aug 27 05:20:33 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f490002a-8f4c-4a54-a1c7-f73dfd7351e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a76a532-7a80-44b1-a6ac-436e46103575]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] <== disconnect_volume: return (288ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing instance network info cache due to event network-changed-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] Acquiring lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] Acquired lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Refreshing network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:20:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG nova.objects.instance [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'flavor' on Instance uuid 7fe87c87-d6bf-4cee-a0f3-67b563122d18 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-217d4b4a-6b7d-47ea-83f9-1ad9db53491f tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.210s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updated VIF entry in instance network info cache for port b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [{"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] Releasing lock "refresh_cache-7fe87c87-d6bf-4cee-a0f3-67b563122d18" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:34 user nova-compute[72904]: WARNING nova.compute.manager [req-ffc29524-b05e-4832-99b0-3e7949f85587 req-4e375604-4a11-429c-9084-cc43083b1012 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received unexpected event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with vm_state active and task_state resize_finish.
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:34 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113635.6834328, 12da6d24-08c6-4b62-bef3-3dbc05b28020 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:35 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] VM Resumed (Lifecycle Event)
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:20:35 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance running successfully.
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Failed to set time: agent not configured {{(pid=72904) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7b01e18d-f1bd-4ea6-b740-feab8d16c1b2 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] finish_migration finished successfully. {{(pid=72904) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:35 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113635.6853898, 12da6d24-08c6-4b62-bef3-3dbc05b28020 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:35 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] VM Started (Lifecycle Event)
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:35 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-a57d6584-76d9-490c-a7df-4e7c42e36b50 req-7050b6e8-f326-4e05-8f21-e39391012716 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a57d6584-76d9-490c-a7df-4e7c42e36b50 req-7050b6e8-f326-4e05-8f21-e39391012716 service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a57d6584-76d9-490c-a7df-4e7c42e36b50 req-7050b6e8-f326-4e05-8f21-e39391012716 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a57d6584-76d9-490c-a7df-4e7c42e36b50 req-7050b6e8-f326-4e05-8f21-e39391012716 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-a57d6584-76d9-490c-a7df-4e7c42e36b50 req-7050b6e8-f326-4e05-8f21-e39391012716 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:35 user nova-compute[72904]: WARNING nova.compute.manager [req-a57d6584-76d9-490c-a7df-4e7c42e36b50 req-7050b6e8-f326-4e05-8f21-e39391012716 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received unexpected event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with vm_state resized and task_state None.
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:20:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:20:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113625.4456885, 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:40 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] VM Stopped (Lifecycle Event)
Aug 27 05:20:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7478MB free_disk=25.035842895507812GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6a1540e2-01cc-4d4c-8a78-1f169af9970f None None] [instance: 6e7ebd2a-e8a7-4ec9-a88d-8c0a997fa049] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Applying migration context for instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 as it has an incoming, in-progress migration de8aaca6-034d-4420-b6bb-3ebba2a32677. Migration status is finished {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 05:20:40 user nova-compute[72904]: INFO nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating resource usage from migration de8aaca6-034d-4420-b6bb-3ebba2a32677
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 63df90c8-8277-4fae-8fd0-37d748101579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 103ea467-b0be-4221-81d4-ef2bbbfddc88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Migration de8aaca6-034d-4420-b6bb-3ebba2a32677 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c2d438f2-0630-4fab-9eab-f00276a01949 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:20:40 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:20:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:20:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:20:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [{"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:20:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:20:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:50 user nova-compute[72904]: INFO nova.compute.manager [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Unrescuing
Aug 27 05:20:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:20:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquired lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:20:50 user nova-compute[72904]: DEBUG nova.network.neutron [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG nova.network.neutron [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updating instance_info_cache with network_info: [{"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Releasing lock "refresh_cache-63df90c8-8277-4fae-8fd0-37d748101579" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG nova.objects.instance [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'flavor' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-6cee1be7-77e6-4547-a559-425f8ae74b91 req-0c1bc938-3bd3-4eb3-8426-d1ec6eb1fe96 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6cee1be7-77e6-4547-a559-425f8ae74b91 req-0c1bc938-3bd3-4eb3-8426-d1ec6eb1fe96 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6cee1be7-77e6-4547-a559-425f8ae74b91 req-0c1bc938-3bd3-4eb3-8426-d1ec6eb1fe96 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6cee1be7-77e6-4547-a559-425f8ae74b91 req-0c1bc938-3bd3-4eb3-8426-d1ec6eb1fe96 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-6cee1be7-77e6-4547-a559-425f8ae74b91 req-0c1bc938-3bd3-4eb3-8426-d1ec6eb1fe96 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:51 user nova-compute[72904]: WARNING nova.compute.manager [req-6cee1be7-77e6-4547-a559-425f8ae74b91 req-0c1bc938-3bd3-4eb3-8426-d1ec6eb1fe96 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:20:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance destroyed successfully.
Aug 27 05:20:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:53 user nova-compute[72904]: WARNING nova.compute.manager [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:20:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:53 user nova-compute[72904]: WARNING nova.compute.manager [req-6f4377f9-2a54-49ce-9a84-413217b00ec1 req-acb57866-514b-427d-a34d-525400bd43b6 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state rescued and task_state unrescuing.
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Removed pending event for 63df90c8-8277-4fae-8fd0-37d748101579 due to event {{(pid=72904) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113655.2102764, 63df90c8-8277-4fae-8fd0-37d748101579 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:55 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] VM Resumed (Lifecycle Event)
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-36ea946c-3780-4044-8305-59f4a31c9be9 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:55 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113655.2119172, 63df90c8-8277-4fae-8fd0-37d748101579 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:20:55 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] VM Started (Lifecycle Event)
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-6dec8d16-300b-4335-afe8-898b71c6695f req-560e1d9a-7123-4b15-9534-7d7fc3df14f3 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6dec8d16-300b-4335-afe8-898b71c6695f req-560e1d9a-7123-4b15-9534-7d7fc3df14f3 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6dec8d16-300b-4335-afe8-898b71c6695f req-560e1d9a-7123-4b15-9534-7d7fc3df14f3 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6dec8d16-300b-4335-afe8-898b71c6695f req-560e1d9a-7123-4b15-9534-7d7fc3df14f3 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:20:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-6dec8d16-300b-4335-afe8-898b71c6695f req-560e1d9a-7123-4b15-9534-7d7fc3df14f3 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:20:55 user nova-compute[72904]: WARNING nova.compute.manager [req-6dec8d16-300b-4335-afe8-898b71c6695f req-560e1d9a-7123-4b15-9534-7d7fc3df14f3 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state active and task_state None.
Aug 27 05:20:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:20:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:22 user nova-compute[72904]: INFO nova.compute.manager [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attaching volume d0ea213e-f851-4fea-9d4d-0788825fc452 to /dev/vdb
Aug 27 05:21:22 user nova-compute[72904]: DEBUG os_brick.utils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dd1f3a-6ca5-4a19-852b-cd5aeb97bf23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[97315e06-fa46-4fcd-8718-a033fd50b59a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceb8659-05b5-4b6e-b2b0-038c3d9f4de6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b452f7af-c492-42c2-830a-d80b61bda224]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:21:22 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:21:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[52179bac-9d42-4086-928f-aba3a0e4982c]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG os_brick.utils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:21:22 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating existing volume attachment record: 34782de7-7c32-4689-b3bf-1541933c36b2 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:21:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:30 user nova-compute[72904]: INFO nova.compute.manager [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Terminating instance
Aug 27 05:21:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:31 user nova-compute[72904]: INFO nova.compute.manager [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Terminating instance
Aug 27 05:21:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-ca8f6d26-936b-49f0-8ab5-a9fca9274e3f req-b7c86f99-6443-4f2a-8830-a2d73f7d7b11 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-unplugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ca8f6d26-936b-49f0-8ab5-a9fca9274e3f req-b7c86f99-6443-4f2a-8830-a2d73f7d7b11 service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ca8f6d26-936b-49f0-8ab5-a9fca9274e3f req-b7c86f99-6443-4f2a-8830-a2d73f7d7b11 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ca8f6d26-936b-49f0-8ab5-a9fca9274e3f req-b7c86f99-6443-4f2a-8830-a2d73f7d7b11 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-ca8f6d26-936b-49f0-8ab5-a9fca9274e3f req-b7c86f99-6443-4f2a-8830-a2d73f7d7b11 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-unplugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-ca8f6d26-936b-49f0-8ab5-a9fca9274e3f req-b7c86f99-6443-4f2a-8830-a2d73f7d7b11 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-unplugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-7a3129bf-35eb-4803-921f-7c330bead79f req-583bd140-fcfa-4570-ae89-eabbea2fabc0 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7a3129bf-35eb-4803-921f-7c330bead79f req-583bd140-fcfa-4570-ae89-eabbea2fabc0 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7a3129bf-35eb-4803-921f-7c330bead79f req-583bd140-fcfa-4570-ae89-eabbea2fabc0 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7a3129bf-35eb-4803-921f-7c330bead79f req-583bd140-fcfa-4570-ae89-eabbea2fabc0 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-7a3129bf-35eb-4803-921f-7c330bead79f req-583bd140-fcfa-4570-ae89-eabbea2fabc0 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:31 user nova-compute[72904]: DEBUG nova.compute.manager [req-7a3129bf-35eb-4803-921f-7c330bead79f req-583bd140-fcfa-4570-ae89-eabbea2fabc0 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Instance destroyed successfully.
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lazy-loading 'resources' on Instance uuid 7fe87c87-d6bf-4cee-a0f3-67b563122d18 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Instance destroyed successfully.
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.objects.instance [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'resources' on Instance uuid d0a4c5ee-08b1-49a8-9a9d-135e9db9237b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-871237085',display_name='tempest-ServerRescueNegativeTestJSON-server-871237085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-871237085',id=17,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:07:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-wakr8260',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:07:06Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=d0a4c5ee-08b1-49a8-9a9d-135e9db9237b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "address": "fa:16:3e:83:01:a7", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14c794cb-b9", "ovs_interfaceid": "14c794cb-b91e-44a9-ab04-1f5e9c51042b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG os_vif [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14c794cb-b9, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2121354445',display_name='tempest-TestMinimumBasicScenario-server-2121354445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2121354445',id=33,image_ref='48268df4-52b1-4c94-b143-234da60dc060',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2vne0q2ZUC4Q2bsG3O4fxg4jfOMXN4zLMMmT4e6uRA2Gh/kSWl4tpDxR1FgiHNxtLkzM8NCxrU80VMmjAvd+6GbGV8H1l81/uKdUbFff/Jv52ZU8oe5NKk8OhnwBLZYA==',key_name='tempest-TestMinimumBasicScenario-830296001',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:16:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9850ebbdbc8d4081ba11931417e4d96b',ramdisk_id='',reservation_id='r-2yfj11rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='48268df4-52b1-4c94-b143-234da60dc060',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-216754606',owner_user_name='tempest-TestMinimumBasicScenario-216754606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:18:46Z,user_data=None,user_id='bc32ad60b20c47f6a7790a8d28bb03dc',uuid=7fe87c87-d6bf-4cee-a0f3-67b563122d18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converting VIF {"id": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "address": "fa:16:3e:e6:e7:f2", "network": {"id": "8e7cc549-b8ca-4ee6-a497-792d218eafc3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1560358604-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9850ebbdbc8d4081ba11931417e4d96b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9a3f7fc-8a", "ovs_interfaceid": "b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e7:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9a3f7fc-8a') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG os_vif [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e7:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9a3f7fc-8a') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9a3f7fc-8a, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: INFO os_vif [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:01:a7,bridge_name='br-int',has_traffic_filtering=True,id=14c794cb-b91e-44a9-ab04-1f5e9c51042b,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14c794cb-b9')
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Deleting instance files /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b_del
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Deletion of /opt/stack/data/nova/instances/d0a4c5ee-08b1-49a8-9a9d-135e9db9237b_del complete
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:21:32 user nova-compute[72904]: INFO os_vif [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:e7:f2,bridge_name='br-int',has_traffic_filtering=True,id=b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7,network=Network(8e7cc549-b8ca-4ee6-a497-792d218eafc3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9a3f7fc-8a')
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Deleting instance files /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18_del
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Deletion of /opt/stack/data/nova/instances/7fe87c87-d6bf-4cee-a0f3-67b563122d18_del complete
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.compute.manager [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 27 05:21:32 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:21:32 user nova-compute[72904]: INFO nova.compute.manager [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 27 05:21:32 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:21:33 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Took 0.97 seconds to deallocate network for instance.
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-83b6fdb8-6fb2-45b5-98d4-1a0aec3648d3 req-737b1a08-d396-434a-8cb8-9652a802b679 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-deleted-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:33 user nova-compute[72904]: INFO nova.compute.manager [req-83b6fdb8-6fb2-45b5-98d4-1a0aec3648d3 req-737b1a08-d396-434a-8cb8-9652a802b679 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Neutron deleted interface 14c794cb-b91e-44a9-ab04-1f5e9c51042b; detaching it from the instance and deleting it from the info cache
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-83b6fdb8-6fb2-45b5-98d4-1a0aec3648d3 req-737b1a08-d396-434a-8cb8-9652a802b679 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-83b6fdb8-6fb2-45b5-98d4-1a0aec3648d3 req-737b1a08-d396-434a-8cb8-9652a802b679 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Detach interface failed, port_id=14c794cb-b91e-44a9-ab04-1f5e9c51042b, reason: Instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:33 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Took 1.04 seconds to deallocate network for instance.
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-ccd5bd92-c744-472e-a8ff-ecc45c51f402 req-12b1dc5b-5ab7-413c-9372-65293d5203a1 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ccd5bd92-c744-472e-a8ff-ecc45c51f402 req-12b1dc5b-5ab7-413c-9372-65293d5203a1 service nova] Acquiring lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ccd5bd92-c744-472e-a8ff-ecc45c51f402 req-12b1dc5b-5ab7-413c-9372-65293d5203a1 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ccd5bd92-c744-472e-a8ff-ecc45c51f402 req-12b1dc5b-5ab7-413c-9372-65293d5203a1 service nova] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-ccd5bd92-c744-472e-a8ff-ecc45c51f402 req-12b1dc5b-5ab7-413c-9372-65293d5203a1 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] No waiting events found dispatching network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:33 user nova-compute[72904]: WARNING nova.compute.manager [req-ccd5bd92-c744-472e-a8ff-ecc45c51f402 req-12b1dc5b-5ab7-413c-9372-65293d5203a1 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received unexpected event network-vif-plugged-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 for instance with vm_state deleted and task_state None.
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.550s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.485s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:33 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Deleted allocations for instance d0a4c5ee-08b1-49a8-9a9d-135e9db9237b
Aug 27 05:21:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-028d2674-b85d-472a-906a-815f9d70985f tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.944s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:34 user nova-compute[72904]: WARNING nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state deleted and task_state None.
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:34 user nova-compute[72904]: WARNING nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state deleted and task_state None.
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:34 user nova-compute[72904]: WARNING nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state deleted and task_state None.
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:34 user nova-compute[72904]: WARNING nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-unplugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state deleted and task_state None.
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Acquiring lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] Lock "d0a4c5ee-08b1-49a8-9a9d-135e9db9237b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] No waiting events found dispatching network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:34 user nova-compute[72904]: WARNING nova.compute.manager [req-08b284cb-955e-4ff1-89e5-ac238e711fa8 req-5b810108-31b4-4dbd-918b-367e91656546 service nova] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Received unexpected event network-vif-plugged-14c794cb-b91e-44a9-ab04-1f5e9c51042b for instance with vm_state deleted and task_state None.
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Deleted allocations for instance 7fe87c87-d6bf-4cee-a0f3-67b563122d18
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d418cb57-f0ca-4d97-9c94-5903bdc47ddb tempest-TestMinimumBasicScenario-216754606 tempest-TestMinimumBasicScenario-216754606-project-member] Lock "7fe87c87-d6bf-4cee-a0f3-67b563122d18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.495s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQOgMWNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:21:34 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:21:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:21:34 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:21:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:21:34 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e995e621-c21d-479b-a44a-8dae4aa41581]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:21:34 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[542eeb80-3440-4b98-9e73-fa59a748c53e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452] added
Aug 27 05:21:34 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:34 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[669bb07f-7f7d-41b0-8a28-0107e0be7fba]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e55a34-a104-455d-b524-afd5277c40fe]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQOgMWNy {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQOgMWNy" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d215b647-3259-4340-a886-8b0f8c75977a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQOgMWNy'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92e355c-d821-4a9d-adb8-209025a269a1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7f2d17-2fac-44ab-a131-e2c97ab0bab9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[832b16f7-a396-40b3-b060-16bb12f9be54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260]
Aug 27 05:21:35 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260] successful.
Aug 27 05:21:35 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce41542-838c-46d3-996d-7e6fba9f3a0a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ed25d4-5d9f-486d-a95d-735e65a88542]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 (non-flash)
Aug 27 05:21:35 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e3be85-20e3-4af8-a1b3-f044234800c4]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-38cf91b7-13eb-4ea0-b6ed-8f7f1b147ebc req-882f933c-366f-4cce-b33e-7e49626b27b0 service nova] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Received event network-vif-deleted-b9a3f7fc-8a7f-4abd-a1ab-f691dd2c8af7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQOgMWNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23833393566323066', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833393566323066', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:21:36 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:21:36 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:21:36 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:21:36 user nova-compute[72904]:   <serial>d0ea213e-f851-4fea-9d4d-0788825fc452</serial>
Aug 27 05:21:36 user nova-compute[72904]: </disk>
Aug 27 05:21:36 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No VIF found with MAC fa:16:3e:c7:0a:42, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2f09f7a6-58a9-41a4-9e78-8c58d08ab45f tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.789s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:21:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=25.090831756591797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Applying migration context for instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 as it has an incoming, in-progress migration de8aaca6-034d-4420-b6bb-3ebba2a32677. Migration status is finished {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 27 05:21:37 user nova-compute[72904]: INFO nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating resource usage from migration de8aaca6-034d-4420-b6bb-3ebba2a32677
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 19a548f0-90c2-47bb-8a68-7a788d7d736b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 63df90c8-8277-4fae-8fd0-37d748101579 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 103ea467-b0be-4221-81d4-ef2bbbfddc88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Migration de8aaca6-034d-4420-b6bb-3ebba2a32677 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c2d438f2-0630-4fab-9eab-f00276a01949 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:21:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:38 user nova-compute[72904]: INFO nova.compute.manager [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Detaching volume d0ea213e-f851-4fea-9d4d-0788825fc452
Aug 27 05:21:38 user nova-compute[72904]: INFO nova.virt.block_device [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attempting to driver detach volume d0ea213e-f851-4fea-9d4d-0788825fc452 from mountpoint /dev/vdb
Aug 27 05:21:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Attempting to detach device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:21:38 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:21:38 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:21:38 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:21:38 user nova-compute[72904]:   <serial>d0ea213e-f851-4fea-9d4d-0788825fc452</serial>
Aug 27 05:21:38 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:21:38 user nova-compute[72904]: </disk>
Aug 27 05:21:38 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:21:38 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config.
Aug 27 05:21:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:21:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:21:38 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:21:38 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:21:38 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:21:38 user nova-compute[72904]:   <serial>d0ea213e-f851-4fea-9d4d-0788825fc452</serial>
Aug 27 05:21:38 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:21:38 user nova-compute[72904]: </disk>
Aug 27 05:21:38 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113699.143643, f88b1d96-56b7-4595-af27-50993d25d527 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:21:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config.
Aug 27 05:21:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQOgMWNy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:21:39 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ba7d83-c5a9-41c0-9f99-f7bb7dd93a65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4aba44-0ff9-47b4-ac9a-479669d9976e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 (non-flash)
Aug 27 05:21:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:21:39 user nova-compute[72904]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 (non-flash)
Aug 27 05:21:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7ce050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7de036-0672-4f37-879d-477df9366273]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e52193a-c1dd-478d-94bc-02d7af4a2c9f]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d123068b-5f65-46cd-bceb-83b6539f4ba4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2228736-5380-40fd-b45e-8fd9b2d68457]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9fafaf-a31a-4b0c-9862-0b5c3f13a549]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b00c7a-e1a8-49a9-8dbb-a5604eba2f4c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260]
Aug 27 05:21:39 user nova-compute[72904]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452, portal: 172.16.0.220,3260] successful.
Aug 27 05:21:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0ea213e-f851-4fea-9d4d-0788825fc452 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d3e925-4c52-4aec-b3ce-d130aa5bd060]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== disconnect_volume: return (274ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:21:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:21:40 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:21:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5873be2-7367-41bb-8226-ebc64479de2d tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.641s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:41 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:21:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:21:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:21:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:21:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:21:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:21:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:21:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:21:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:45 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113692.0771763, 7fe87c87-d6bf-4cee-a0f3-67b563122d18 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:21:47 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] VM Stopped (Lifecycle Event)
Aug 27 05:21:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0048ef62-9af1-4ff0-8818-c34b155beaa2 None None] [instance: 7fe87c87-d6bf-4cee-a0f3-67b563122d18] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113692.1266816, d0a4c5ee-08b1-49a8-9a9d-135e9db9237b => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:21:47 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] VM Stopped (Lifecycle Event)
Aug 27 05:21:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0d709ef0-6ad6-4be7-9270-9122925a99cd None None] [instance: d0a4c5ee-08b1-49a8-9a9d-135e9db9237b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:21:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:50 user nova-compute[72904]: INFO nova.compute.manager [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Terminating instance
Aug 27 05:21:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-ebb731e3-6cd3-4335-9da3-080aead0891a req-b6bf8d30-197e-4b23-9b77-52a1a300abfa service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-unplugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ebb731e3-6cd3-4335-9da3-080aead0891a req-b6bf8d30-197e-4b23-9b77-52a1a300abfa service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ebb731e3-6cd3-4335-9da3-080aead0891a req-b6bf8d30-197e-4b23-9b77-52a1a300abfa service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ebb731e3-6cd3-4335-9da3-080aead0891a req-b6bf8d30-197e-4b23-9b77-52a1a300abfa service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-ebb731e3-6cd3-4335-9da3-080aead0891a req-b6bf8d30-197e-4b23-9b77-52a1a300abfa service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-unplugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-ebb731e3-6cd3-4335-9da3-080aead0891a req-b6bf8d30-197e-4b23-9b77-52a1a300abfa service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-unplugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:21:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Instance destroyed successfully.
Aug 27 05:21:51 user nova-compute[72904]: DEBUG nova.objects.instance [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lazy-loading 'resources' on Instance uuid 103ea467-b0be-4221-81d4-ef2bbbfddc88 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1446970509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1446970509',id=32,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiQrgc7A7FjqhVOjH4sy6MrmRYpNDFLhOIbKzqYBivxl7GfmXPfG/csWNrDOmp9PJob43UD+0UUaeVIkzTitEjgvxsrO8vRi0Dt1cbc5yB/9L4HLwYYIqo/agkI6byQoQ==',key_name='tempest-keypair-989204785',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0fc9180eede040eaa688e81896d5c3c4',ramdisk_id='',reservation_id='r-ib4vtnbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1010055172',owner_user_name='tempest-AttachVolumeShelveTestJSON-1010055172-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:20:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd521a1e127f496fa4e7865cfedf106f',uuid=103ea467-b0be-4221-81d4-ef2bbbfddc88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converting VIF {"id": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "address": "fa:16:3e:b6:fe:dc", "network": {"id": "eeedd4f2-1db5-46db-b908-5f03f32518b4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-121952874-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0fc9180eede040eaa688e81896d5c3c4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa31f90c2-af", "ovs_interfaceid": "a31f90c2-aff5-4bb0-9c12-89e8ecd30797", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG os_vif [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa31f90c2-af, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:51 user nova-compute[72904]: INFO os_vif [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:fe:dc,bridge_name='br-int',has_traffic_filtering=True,id=a31f90c2-aff5-4bb0-9c12-89e8ecd30797,network=Network(eeedd4f2-1db5-46db-b908-5f03f32518b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa31f90c2-af')
Aug 27 05:21:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Deleting instance files /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88_del
Aug 27 05:21:51 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Deletion of /opt/stack/data/nova/instances/103ea467-b0be-4221-81d4-ef2bbbfddc88_del complete
Aug 27 05:21:51 user nova-compute[72904]: INFO nova.compute.manager [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 27 05:21:51 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:21:51 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:21:52 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Took 0.82 seconds to deallocate network for instance.
Aug 27 05:21:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:52 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Deleted allocations for instance 103ea467-b0be-4221-81d4-ef2bbbfddc88
Aug 27 05:21:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-aa1cccb2-ba15-4e55-861a-77ff42b62df0 tempest-AttachVolumeShelveTestJSON-1010055172 tempest-AttachVolumeShelveTestJSON-1010055172-project-member] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-db0db539-e4f5-4093-b29c-a2a0d051e7e6 req-8e33b60b-530d-4fbc-8322-e1f3483573d7 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-db0db539-e4f5-4093-b29c-a2a0d051e7e6 req-8e33b60b-530d-4fbc-8322-e1f3483573d7 service nova] Acquiring lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-db0db539-e4f5-4093-b29c-a2a0d051e7e6 req-8e33b60b-530d-4fbc-8322-e1f3483573d7 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-db0db539-e4f5-4093-b29c-a2a0d051e7e6 req-8e33b60b-530d-4fbc-8322-e1f3483573d7 service nova] Lock "103ea467-b0be-4221-81d4-ef2bbbfddc88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:21:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-db0db539-e4f5-4093-b29c-a2a0d051e7e6 req-8e33b60b-530d-4fbc-8322-e1f3483573d7 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] No waiting events found dispatching network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:21:52 user nova-compute[72904]: WARNING nova.compute.manager [req-db0db539-e4f5-4093-b29c-a2a0d051e7e6 req-8e33b60b-530d-4fbc-8322-e1f3483573d7 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received unexpected event network-vif-plugged-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 for instance with vm_state deleted and task_state None.
Aug 27 05:21:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-db0db539-e4f5-4093-b29c-a2a0d051e7e6 req-8e33b60b-530d-4fbc-8322-e1f3483573d7 service nova] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Received event network-vif-deleted-a31f90c2-aff5-4bb0-9c12-89e8ecd30797 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:21:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Going to confirm migration 2 {{(pid=72904) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 27 05:22:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:22:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquired lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:22:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:22:00 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'info_cache' on Instance uuid 12da6d24-08c6-4b62-bef3-3dbc05b28020 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG nova.network.neutron [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Releasing lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'migration_context' on Instance uuid 12da6d24-08c6-4b62-bef3-3dbc05b28020 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG nova.objects.base [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Object Instance<12da6d24-08c6-4b62-bef3-3dbc05b28020> lazy-loaded attributes: info_cache,migration_context {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:22:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.354s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:01 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Deleted allocation for migration de8aaca6-034d-4420-b6bb-3ebba2a32677
Aug 27 05:22:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e7c6988-03b7-43b7-b0a8-6f2a7f4aba66 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.256s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing instance network info cache due to event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:22:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:22:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:22:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG nova.network.neutron [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updated VIF entry in instance network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG nova.network.neutron [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dfe52081-0dbb-487b-93af-dddcc2624667 req-f4dee295-ceb9-426c-b1fb-bcf307adca03 service nova] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:04 user nova-compute[72904]: INFO nova.compute.manager [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Shelve offloading
Aug 27 05:22:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-3eaf216b-ead4-4308-97c7-07bcab9e12e6 req-b7d22587-4754-4898-83d0-155c979b743d service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-unplugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3eaf216b-ead4-4308-97c7-07bcab9e12e6 req-b7d22587-4754-4898-83d0-155c979b743d service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3eaf216b-ead4-4308-97c7-07bcab9e12e6 req-b7d22587-4754-4898-83d0-155c979b743d service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3eaf216b-ead4-4308-97c7-07bcab9e12e6 req-b7d22587-4754-4898-83d0-155c979b743d service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-3eaf216b-ead4-4308-97c7-07bcab9e12e6 req-b7d22587-4754-4898-83d0-155c979b743d service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-unplugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:22:04 user nova-compute[72904]: WARNING nova.compute.manager [req-3eaf216b-ead4-4308-97c7-07bcab9e12e6 req-b7d22587-4754-4898-83d0-155c979b743d service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received unexpected event network-vif-unplugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with vm_state active and task_state shelving.
Aug 27 05:22:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:05 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance destroyed successfully.
Aug 27 05:22:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:22:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:22:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:22:05 user nova-compute[72904]: DEBUG nova.network.neutron [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:22:05 user nova-compute[72904]: DEBUG nova.network.neutron [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113711.0682814, 103ea467-b0be-4221-81d4-ef2bbbfddc88 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:22:06 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] VM Stopped (Lifecycle Event)
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-2a37f425-0225-4a8c-8768-01e77ff12fba None None] [instance: 103ea467-b0be-4221-81d4-ef2bbbfddc88] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance destroyed successfully.
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'resources' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-877479218',display_name='tempest-TestShelveInstance-server-877479218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-877479218',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO/iPXTu/fu6ydtm7XM3fu0hQRmXBEu08sy3yMGf8dkOC9xCqtIt2kUGIRuyGp5myE1oRLwcSFevSSXAHPtWvdNz9GGnC0v+ntXMXJmNB4jHQzYQawwX8LWHb3RsKXA9Q==',key_name='tempest-TestShelveInstance-1274547691',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='508d0e5f51934ac9ad219665714ad215',ramdisk_id='',reservation_id='r-lrjlnj1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-863084300',owner_user_name='tempest-TestShelveInstance-863084300-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:20:32Z,user_data=None,user_id='aff961cb4ba4410fb4c7fba4ca907779',uuid=c2d438f2-0630-4fab-9eab-f00276a01949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converting VIF {"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_vif [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83b0b06-36, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing instance network info cache due to event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:22:06 user nova-compute[72904]: INFO os_vif [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36')
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:22:06 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[554af805-89cb-46f4-b79a-019f69c692cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a52e835-8dbd-4a04-abd6-1fd3ff83d3f6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:06 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:22:06 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:22:06 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:06 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:06 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:22:06 user nova-compute[72904]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:22:06 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:06 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7dc940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'): ({'sde'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Removing single pathed devices sde {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f252c-822a-4b06-840a-f1cce0410c99]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e89978-b1ff-4c42-b1af-769912853c65]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Flushing IO for device /dev/sde {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5185327-795c-40e6-a2e3-74bd7dd773fe]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaafa43-e9a4-44e7-85ff-b10312076995]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] SCSI volumes sde have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce4edd5-24bf-4e0e-a8c4-c52fc88cf7fc]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d1a787-03ff-442d-9feb-c0b366db8cfc]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]
Aug 27 05:22:06 user nova-compute[72904]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.
Aug 27 05:22:06 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[df39feec-4ee7-4ca1-ae63-4518d2f39db0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] <== disconnect_volume: return (286ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:22:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Deleting instance files /opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949_del
Aug 27 05:22:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Deletion of /opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949_del complete
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2cdeb6c-1133-464a-b3fc-1cfecf853010 req-f330c2d3-74de-4baa-947a-24c639816939 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2cdeb6c-1133-464a-b3fc-1cfecf853010 req-f330c2d3-74de-4baa-947a-24c639816939 service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2cdeb6c-1133-464a-b3fc-1cfecf853010 req-f330c2d3-74de-4baa-947a-24c639816939 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c2cdeb6c-1133-464a-b3fc-1cfecf853010 req-f330c2d3-74de-4baa-947a-24c639816939 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-c2cdeb6c-1133-464a-b3fc-1cfecf853010 req-f330c2d3-74de-4baa-947a-24c639816939 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:22:06 user nova-compute[72904]: WARNING nova.compute.manager [req-c2cdeb6c-1133-464a-b3fc-1cfecf853010 req-f330c2d3-74de-4baa-947a-24c639816939 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received unexpected event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with vm_state active and task_state shelving.
Aug 27 05:22:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updated VIF entry in instance network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:22:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": null, "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc83b0b06-36", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dbe6d1ce-3095-4437-b9c9-68c7ae5cf336 req-4934a33b-56a7-4511-87e1-aa044df8b25c service nova] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:22:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:07 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Deleted allocations for instance c2d438f2-0630-4fab-9eab-f00276a01949
Aug 27 05:22:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:07 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'numa_topology' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:07 user nova-compute[72904]: DEBUG nova.objects.base [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Object Instance<c2d438f2-0630-4fab-9eab-f00276a01949> lazy-loaded attributes: resources,numa_topology {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:22:08 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:22:08 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:22:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c2b91407-b202-4068-8a22-be047da7dcc0 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.716s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:20 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113725.2582095, c2d438f2-0630-4fab-9eab-f00276a01949 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:22:20 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] VM Stopped (Lifecycle Event)
Aug 27 05:22:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-389e4129-9b12-4d54-8394-25a4a9c620ca None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:22:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:22:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:22:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:22:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:22:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:22 user nova-compute[72904]: INFO nova.compute.manager [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Terminating instance
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-c0556117-b558-4f22-bcd7-53fa3ce8cedb req-79ba0497-77c9-4621-86a0-c44515b71c22 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c0556117-b558-4f22-bcd7-53fa3ce8cedb req-79ba0497-77c9-4621-86a0-c44515b71c22 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c0556117-b558-4f22-bcd7-53fa3ce8cedb req-79ba0497-77c9-4621-86a0-c44515b71c22 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c0556117-b558-4f22-bcd7-53fa3ce8cedb req-79ba0497-77c9-4621-86a0-c44515b71c22 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-c0556117-b558-4f22-bcd7-53fa3ce8cedb req-79ba0497-77c9-4621-86a0-c44515b71c22 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-c0556117-b558-4f22-bcd7-53fa3ce8cedb req-79ba0497-77c9-4621-86a0-c44515b71c22 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-unplugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:22:22 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Instance destroyed successfully.
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lazy-loading 'resources' on Instance uuid 19a548f0-90c2-47bb-8a68-7a788d7d736b {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:05:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929196508',display_name='tempest-ServerRescueNegativeTestJSON-server-1929196508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929196508',id=16,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1b16eb565e64463c9a6e61ddcad25728',ramdisk_id='',reservation_id='r-gd8c0sey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-275121126',owner_user_name='tempest-ServerRescueNegativeTestJSON-275121126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:11:52Z,user_data=None,user_id='223d760d5f03408781a9241f98a5a6c8',uuid=19a548f0-90c2-47bb-8a68-7a788d7d736b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converting VIF {"id": "9d900a0d-2639-401f-90f9-de3ad2392683", "address": "fa:16:3e:92:42:3e", "network": {"id": "3809fd23-e39b-40fb-be2a-052e80cdef3e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-519001118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1b16eb565e64463c9a6e61ddcad25728", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d900a0d-26", "ovs_interfaceid": "9d900a0d-2639-401f-90f9-de3ad2392683", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG os_vif [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d900a0d-26, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:22:22 user nova-compute[72904]: INFO os_vif [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:42:3e,bridge_name='br-int',has_traffic_filtering=True,id=9d900a0d-2639-401f-90f9-de3ad2392683,network=Network(3809fd23-e39b-40fb-be2a-052e80cdef3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d900a0d-26')
Aug 27 05:22:22 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Deleting instance files /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b_del
Aug 27 05:22:22 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Deletion of /opt/stack/data/nova/instances/19a548f0-90c2-47bb-8a68-7a788d7d736b_del complete
Aug 27 05:22:22 user nova-compute[72904]: INFO nova.compute.manager [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 27 05:22:22 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:22:22 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:22:23 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:23 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Took 0.56 seconds to deallocate network for instance.
Aug 27 05:22:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:23 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:22:23 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:22:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:23 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Deleted allocations for instance 19a548f0-90c2-47bb-8a68-7a788d7d736b
Aug 27 05:22:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dbff1d7c-2ea0-47b1-9c79-99d54f243958 tempest-ServerRescueNegativeTestJSON-275121126 tempest-ServerRescueNegativeTestJSON-275121126-project-member] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.695s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-eaf0df7b-79e6-42f9-9c67-77aca92084f3 req-b99e37d2-290a-44a1-90da-818a49f2db78 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eaf0df7b-79e6-42f9-9c67-77aca92084f3 req-b99e37d2-290a-44a1-90da-818a49f2db78 service nova] Acquiring lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eaf0df7b-79e6-42f9-9c67-77aca92084f3 req-b99e37d2-290a-44a1-90da-818a49f2db78 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eaf0df7b-79e6-42f9-9c67-77aca92084f3 req-b99e37d2-290a-44a1-90da-818a49f2db78 service nova] Lock "19a548f0-90c2-47bb-8a68-7a788d7d736b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-eaf0df7b-79e6-42f9-9c67-77aca92084f3 req-b99e37d2-290a-44a1-90da-818a49f2db78 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] No waiting events found dispatching network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:22:24 user nova-compute[72904]: WARNING nova.compute.manager [req-eaf0df7b-79e6-42f9-9c67-77aca92084f3 req-b99e37d2-290a-44a1-90da-818a49f2db78 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received unexpected event network-vif-plugged-9d900a0d-2639-401f-90f9-de3ad2392683 for instance with vm_state deleted and task_state None.
Aug 27 05:22:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-eaf0df7b-79e6-42f9-9c67-77aca92084f3 req-b99e37d2-290a-44a1-90da-818a49f2db78 service nova] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Received event network-vif-deleted-9d900a0d-2639-401f-90f9-de3ad2392683 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:32 user nova-compute[72904]: DEBUG nova.objects.instance [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:32 user nova-compute[72904]: INFO nova.compute.manager [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attaching volume 7994ade9-546a-4a16-abf6-d2ab5986aab9 to /dev/vdb
Aug 27 05:22:33 user nova-compute[72904]: DEBUG os_brick.utils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89e394c-d34a-45cb-a59e-8477e106def6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeda86f4-7aea-4b31-9f85-aed251fcad44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f0766-bdf4-455f-95ae-9039fdd97f6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1588686e-b346-4c54-a42b-302809280102]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:22:33 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:22:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55b03a7-124e-4f55-9b15-fc05cc6bb5cc]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG os_brick.utils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:22:33 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating existing volume attachment record: 1595cd47-60a0-4974-8b65-019e7ed2bdaa {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:35 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113742.7191367, 19a548f0-90c2-47bb-8a68-7a788d7d736b => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:22:37 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] VM Stopped (Lifecycle Event)
Aug 27 05:22:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:22:37 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=7964MB free_disk=25.184768676757812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8140124d-98f6-4064-98f0-bfe17a942ca4 None None] [instance: 19a548f0-90c2-47bb-8a68-7a788d7d736b] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 63df90c8-8277-4fae-8fd0-37d748101579 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:22:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:22:38 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:22:38 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:22:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:22:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "63df90c8-8277-4fae-8fd0-37d748101579" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:41 user nova-compute[72904]: INFO nova.compute.manager [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Terminating instance
Aug 27 05:22:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-4b52daa9-bf6e-4c15-a360-7e7b56973292 req-3c168231-84cd-4def-be0f-073106781aba service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4b52daa9-bf6e-4c15-a360-7e7b56973292 req-3c168231-84cd-4def-be0f-073106781aba service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4b52daa9-bf6e-4c15-a360-7e7b56973292 req-3c168231-84cd-4def-be0f-073106781aba service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4b52daa9-bf6e-4c15-a360-7e7b56973292 req-3c168231-84cd-4def-be0f-073106781aba service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-4b52daa9-bf6e-4c15-a360-7e7b56973292 req-3c168231-84cd-4def-be0f-073106781aba service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-4b52daa9-bf6e-4c15-a360-7e7b56973292 req-3c168231-84cd-4def-be0f-073106781aba service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-unplugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:22:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Instance destroyed successfully.
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.objects.instance [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'resources' on Instance uuid 63df90c8-8277-4fae-8fd0-37d748101579 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1777426695',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1777426695',id=34,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:19:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-f237q405',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:20:55Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=63df90c8-8277-4fae-8fd0-37d748101579,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "address": "fa:16:3e:06:f1:54", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ca4ef45-c5", "ovs_interfaceid": "2ca4ef45-c505-4a43-b318-6ddd3518593f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_vif [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ca4ef45-c5, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:22:42 user nova-compute[72904]: INFO os_vif [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:f1:54,bridge_name='br-int',has_traffic_filtering=True,id=2ca4ef45-c505-4a43-b318-6ddd3518593f,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ca4ef45-c5')
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tExwZPHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:22:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6afa10-7c7f-4f88-ba3a-a5d8cbe8149a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d380f6cc-00c1-43cf-8a27-7bf3bb33a77d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:42 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:22:42 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:42 user nova-compute[72904]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 (non-flash)
Aug 27 05:22:42 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7dfd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28'): ({'sdf'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Removing single pathed devices sdf {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72fdf7b-d545-43e4-a4a8-e2b860d9e5da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[885ddfa3-30a2-4f94-bc54-e4aa934f47b6]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flushing IO for device /dev/sdf {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea287dc4-087d-456e-81c7-e1f1c4081eaf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6f39b4-d67a-422f-830a-38efbb90febd]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] SCSI volumes sdf have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26138306436616633', '/dev/disk/by-id/scsi-1SCST_BIOa45169bc-a80d6af36794085e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a45169bc') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c17451d-6369-4f7b-8656-dc8628106b6c]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75eeb5-6754-4f18-888a-d72df9c4860e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dce1ee6-6eaa-4583-8f28-d745c01e0529]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260]
Aug 27 05:22:42 user nova-compute[72904]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28, portal: 172.16.0.220,3260] successful.
Aug 27 05:22:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d22c3bb2-4feb-42f0-ad6b-3b0fdff93b28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1df4d4-92de-4678-b309-8b1550dbb00e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== disconnect_volume: return (294ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:22:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Deleting instance files /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579_del
Aug 27 05:22:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Deletion of /opt/stack/data/nova/instances/63df90c8-8277-4fae-8fd0-37d748101579_del complete
Aug 27 05:22:42 user nova-compute[72904]: INFO nova.compute.manager [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 27 05:22:42 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:22:42 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:22:43 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-48c548cb-a2ae-4374-9cf8-392df55d3580 req-8070c485-ed8d-45a6-9054-02b0f0ffd2d7 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-deleted-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:43 user nova-compute[72904]: INFO nova.compute.manager [req-48c548cb-a2ae-4374-9cf8-392df55d3580 req-8070c485-ed8d-45a6-9054-02b0f0ffd2d7 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Neutron deleted interface 2ca4ef45-c505-4a43-b318-6ddd3518593f; detaching it from the instance and deleting it from the info cache
Aug 27 05:22:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-48c548cb-a2ae-4374-9cf8-392df55d3580 req-8070c485-ed8d-45a6-9054-02b0f0ffd2d7 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:43 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Took 0.58 seconds to deallocate network for instance.
Aug 27 05:22:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-48c548cb-a2ae-4374-9cf8-392df55d3580 req-8070c485-ed8d-45a6-9054-02b0f0ffd2d7 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Detach interface failed, port_id=2ca4ef45-c505-4a43-b318-6ddd3518593f, reason: Instance 63df90c8-8277-4fae-8fd0-37d748101579 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:22:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:22:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:22:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:22:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.compute.manager [req-94e8d12d-8dbb-4c32-bf14-adda42dde3fd req-df825095-a1cc-4af4-98ec-8df2264ec694 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-94e8d12d-8dbb-4c32-bf14-adda42dde3fd req-df825095-a1cc-4af4-98ec-8df2264ec694 service nova] Acquiring lock "63df90c8-8277-4fae-8fd0-37d748101579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-94e8d12d-8dbb-4c32-bf14-adda42dde3fd req-df825095-a1cc-4af4-98ec-8df2264ec694 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-94e8d12d-8dbb-4c32-bf14-adda42dde3fd req-df825095-a1cc-4af4-98ec-8df2264ec694 service nova] Lock "63df90c8-8277-4fae-8fd0-37d748101579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.compute.manager [req-94e8d12d-8dbb-4c32-bf14-adda42dde3fd req-df825095-a1cc-4af4-98ec-8df2264ec694 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] No waiting events found dispatching network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:22:44 user nova-compute[72904]: WARNING nova.compute.manager [req-94e8d12d-8dbb-4c32-bf14-adda42dde3fd req-df825095-a1cc-4af4-98ec-8df2264ec694 service nova] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Received unexpected event network-vif-plugged-2ca4ef45-c505-4a43-b318-6ddd3518593f for instance with vm_state active and task_state deleting.
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [{"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:22:44 user nova-compute[72904]: INFO nova.compute.manager [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Took 0.87 seconds to detach 1 volumes for instance.
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-811276f1-7d8e-4b92-9cb0-239ad4121cff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:44 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Deleted allocations for instance 63df90c8-8277-4fae-8fd0-37d748101579
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-611952a5-5892-40bc-a863-35c14f2f3f54 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "63df90c8-8277-4fae-8fd0-37d748101579" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.081s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBnAhQwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:22:44 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:22:44 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:22:44 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c8c927-dde8-4ceb-8abe-4b480ae5194a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:22:44 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e716783a-03bc-414a-97f9-bc96e5e3c135]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9] added
Aug 27 05:22:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb929fb3-ea2f-451c-9c76-f9d24ed2d648]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874a70b-3d83-4ea2-b8db-312f4a51c145]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBnAhQwM {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBnAhQwM" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedf4737-93f4-46a3-a962-cea05083a9cb]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBnAhQwM'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa618e96-26fc-425a-bf4a-cfe5879e65bb]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fac9ed-fac7-4045-9721-fc4ec47376b9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:44 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:44 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c39157-dfce-4550-82f2-eee274d77b6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260]
Aug 27 05:22:44 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260] successful.
Aug 27 05:22:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a29bb3-d5fb-48ad-9b0d-5c72dea63f2c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[18efa01b-f496-40b5-99a6-e580bf6c2457]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:45 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:45 user nova-compute[72904]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 (non-flash)
Aug 27 05:22:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:45 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:45 user nova-compute[72904]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 (non-flash)
Aug 27 05:22:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2aad7a-d3e1-4b19-a0c2-746c50de7644]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBnAhQwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23930393031316532', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930393031316532', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG nova.objects.instance [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:22:46 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:22:46 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:22:46 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:22:46 user nova-compute[72904]:   <serial>7994ade9-546a-4a16-abf6-d2ab5986aab9</serial>
Aug 27 05:22:46 user nova-compute[72904]: </disk>
Aug 27 05:22:46 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No VIF found with MAC fa:16:3e:c7:0a:42, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9695683b-ecd0-4bcd-9611-281e13352387 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.620s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:46 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:22:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:22:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:22:48 user nova-compute[72904]: INFO nova.compute.manager [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Detaching volume 7994ade9-546a-4a16-abf6-d2ab5986aab9
Aug 27 05:22:48 user nova-compute[72904]: INFO nova.virt.block_device [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attempting to driver detach volume 7994ade9-546a-4a16-abf6-d2ab5986aab9 from mountpoint /dev/vdb
Aug 27 05:22:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Attempting to detach device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:22:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:22:48 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:22:48 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:22:48 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:22:48 user nova-compute[72904]:   <serial>7994ade9-546a-4a16-abf6-d2ab5986aab9</serial>
Aug 27 05:22:48 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:22:48 user nova-compute[72904]: </disk>
Aug 27 05:22:48 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:22:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config.
Aug 27 05:22:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:22:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:22:48 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:22:48 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:22:48 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:22:48 user nova-compute[72904]:   <serial>7994ade9-546a-4a16-abf6-d2ab5986aab9</serial>
Aug 27 05:22:48 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:22:48 user nova-compute[72904]: </disk>
Aug 27 05:22:48 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113769.2373133, f88b1d96-56b7-4595-af27-50993d25d527 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:22:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config.
Aug 27 05:22:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBnAhQwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:22:49 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a912ba1-1a65-43a0-b9c9-274e9e5b283a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3bf56c-dd8a-4ab5-accd-761608cd8aa7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:49 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:49 user nova-compute[72904]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 (non-flash)
Aug 27 05:22:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:22:49 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:22:49 user nova-compute[72904]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 (non-flash)
Aug 27 05:22:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91943f4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31af39-1531-4644-a79a-6b3018ea1f02]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6c0263-f08d-4f18-a8e7-7193a17cafe6]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf97742-7613-4c8b-8363-0d6c818e9e15]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb0d298-8c41-4baf-8340-187819f6a6c3]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f7e95a-31a4-4055-89f8-5c9e5bd9d72a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6e2258-fe42-48ac-b862-386c328f06d1]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260]
Aug 27 05:22:49 user nova-compute[72904]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9, portal: 172.16.0.220,3260] successful.
Aug 27 05:22:49 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7994ade9-546a-4a16-abf6-d2ab5986aab9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4290d2d2-a7ea-48ee-9566-f6cc0c87ffc7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== disconnect_volume: return (324ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:22:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:22:50 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:22:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1271c15d-4646-42e8-8da9-f88ba74d16c7 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.866s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:22:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:22:57 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113762.3691208, 63df90c8-8277-4fae-8fd0-37d748101579 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:22:57 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] VM Stopped (Lifecycle Event)
Aug 27 05:22:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-4fe11b3c-f938-470d-a816-aec95257adda None None] [instance: 63df90c8-8277-4fae-8fd0-37d748101579] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:22:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:23:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:23:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:23:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:23:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:23:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:23:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:23:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:32 user nova-compute[72904]: INFO nova.compute.manager [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Terminating instance
Aug 27 05:23:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-6ecf43ec-2bd1-463e-bc04-6ed2c3121def req-63957475-78f9-443d-9d46-294e88369d5d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received event network-vif-unplugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6ecf43ec-2bd1-463e-bc04-6ed2c3121def req-63957475-78f9-443d-9d46-294e88369d5d service nova] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6ecf43ec-2bd1-463e-bc04-6ed2c3121def req-63957475-78f9-443d-9d46-294e88369d5d service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6ecf43ec-2bd1-463e-bc04-6ed2c3121def req-63957475-78f9-443d-9d46-294e88369d5d service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-6ecf43ec-2bd1-463e-bc04-6ed2c3121def req-63957475-78f9-443d-9d46-294e88369d5d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] No waiting events found dispatching network-vif-unplugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:23:32 user nova-compute[72904]: DEBUG nova.compute.manager [req-6ecf43ec-2bd1-463e-bc04-6ed2c3121def req-63957475-78f9-443d-9d46-294e88369d5d service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received event network-vif-unplugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:33 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Instance destroyed successfully.
Aug 27 05:23:33 user nova-compute[72904]: DEBUG nova.objects.instance [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'resources' on Instance uuid 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:14:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-618888764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-618888764',id=29,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:14:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-w4d6dikg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:16:05Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=10c3d7d3-4b6e-4ca1-9b22-d84f865867cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "address": "fa:16:3e:11:12:07", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ed0a785-db", "ovs_interfaceid": "7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:07,bridge_name='br-int',has_traffic_filtering=True,id=7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0a785-db') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG os_vif [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:07,bridge_name='br-int',has_traffic_filtering=True,id=7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0a785-db') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ed0a785-db, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:23:33 user nova-compute[72904]: INFO os_vif [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:12:07,bridge_name='br-int',has_traffic_filtering=True,id=7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ed0a785-db')
Aug 27 05:23:33 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Deleting instance files /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb_del
Aug 27 05:23:33 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Deletion of /opt/stack/data/nova/instances/10c3d7d3-4b6e-4ca1-9b22-d84f865867cb_del complete
Aug 27 05:23:33 user nova-compute[72904]: INFO nova.compute.manager [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 27 05:23:33 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:23:33 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:23:34 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:23:34 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Took 0.80 seconds to deallocate network for instance.
Aug 27 05:23:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:34 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:23:34 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:23:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:34 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Deleted allocations for instance 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb
Aug 27 05:23:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-2415ead6-3a42-45fb-9379-b4df671cedc1 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-43c07bc6-af48-4f92-abb0-31c52916294a req-7b19611b-6953-470b-8c7a-09debf8f6b4e service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received event network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:23:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-43c07bc6-af48-4f92-abb0-31c52916294a req-7b19611b-6953-470b-8c7a-09debf8f6b4e service nova] Acquiring lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-43c07bc6-af48-4f92-abb0-31c52916294a req-7b19611b-6953-470b-8c7a-09debf8f6b4e service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-43c07bc6-af48-4f92-abb0-31c52916294a req-7b19611b-6953-470b-8c7a-09debf8f6b4e service nova] Lock "10c3d7d3-4b6e-4ca1-9b22-d84f865867cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-43c07bc6-af48-4f92-abb0-31c52916294a req-7b19611b-6953-470b-8c7a-09debf8f6b4e service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] No waiting events found dispatching network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:23:35 user nova-compute[72904]: WARNING nova.compute.manager [req-43c07bc6-af48-4f92-abb0-31c52916294a req-7b19611b-6953-470b-8c7a-09debf8f6b4e service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received unexpected event network-vif-plugged-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec for instance with vm_state deleted and task_state None.
Aug 27 05:23:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-43c07bc6-af48-4f92-abb0-31c52916294a req-7b19611b-6953-470b-8c7a-09debf8f6b4e service nova] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Received event network-vif-deleted-7ed0a785-dbb0-4822-af9b-2f2e5ea2f2ec {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:23:36 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:36 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:23:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:23:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:38 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:23:38 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8229MB free_disk=25.29910659790039GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:23:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG nova.objects.instance [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:42 user nova-compute[72904]: INFO nova.compute.manager [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attaching volume d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d to /dev/vdb
Aug 27 05:23:43 user nova-compute[72904]: DEBUG os_brick.utils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f53d5f-0c8b-433a-b606-a01c7ce84431]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdef2ddb-6eef-4e5e-89e9-46922a8e6112]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc51434c-29af-4e9f-8eba-659502844bec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e7bcf-a98a-4e37-a18f-61cc5ccb01cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:23:43 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f504688-9f4c-418f-88f7-a654190815f5]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG os_brick.utils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating existing volume attachment record: 4f2b2478-fd64-4435-8623-e14a5509bbd7 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:23:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:23:44 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating instance_info_cache with network_info: [{"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:23:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f88b1d96-56b7-4595-af27-50993d25d527" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:23:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:23:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:23:45 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:45 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:48 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113813.3201163, 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:23:48 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] VM Stopped (Lifecycle Event)
Aug 27 05:23:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-95a3dfcf-30c4-4068-b3bd-8e68a93b8647 None None] [instance: 10c3d7d3-4b6e-4ca1-9b22-d84f865867cb] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:23:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:23:51 user nova-compute[72904]: INFO nova.compute.manager [None req-d5a4a0c2-3979-47b5-beb5-edd955f0441f tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Get console output
Aug 27 05:23:52 user nova-compute[72904]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 27 05:23:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:23:55 user nova-compute[72904]: INFO nova.compute.manager [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Unshelving
Aug 27 05:23:55 user nova-compute[72904]: INFO nova.virt.block_device [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Booting with volume 81633978-c3ab-4770-98d8-e207b4f7992b at /dev/vda
Aug 27 05:23:55 user nova-compute[72904]: DEBUG os_brick.utils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0faadb-e71f-4d0f-8ac4-a5968b6378d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafdf7d2-958e-4ba2-88a6-deee0ee98244]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01ad5ae-cf2a-4ff0-a3ec-16c45e9e93b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6947fb48-d677-48b0-a5f0-79a54a368c53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:23:56 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[58191e66-0793-44b9-ae81-fc4e3e77fba7]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.utils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating existing volume attachment record: e5437b05-0f1b-4146-89b1-43f6de4b7369 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CobVunqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:23:56 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:23:56 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:23:56 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6924b11f-1c0b-403b-9251-ccfcc1a43298]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:23:56 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[239656eb-b1d5-43ee-9402-598555d95559]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d] added
Aug 27 05:23:56 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a921e5-ed84-4467-9e28-fa9a4c13ade1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51a045-9e9e-488a-8c00-9504567ccd88]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CobVunqN {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CobVunqN" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e0dd2b-40d4-4664-83b7-5957102754d4]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CobVunqN'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482ebed-0e4c-4c7c-b3a9-b4d91dbffd59]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d245c2f5-bd41-41b0-9621-7979f0ebd9f9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:23:57 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:23:57 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:23:57 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:23:57 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ea981-199e-4a96-8fb8-89708c0b51e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260]
Aug 27 05:23:57 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260] successful.
Aug 27 05:23:57 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b19dbee-a90b-46d6-871f-98fdda3efb66]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[966e6573-e71d-444a-b3dc-e2337f148dd7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:23:57 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:23:57 user nova-compute[72904]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d (non-flash)
Aug 27 05:23:57 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:23:57 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:23:57 user nova-compute[72904]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d (non-flash)
Aug 27 05:23:57 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ff9b0d-d3c6-4804-9182-d5f57e9e5a61]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:23:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CobVunqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26433306264333530', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433306264333530', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG nova.objects.instance [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:23:58 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:23:58 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:23:58 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:23:58 user nova-compute[72904]:   <serial>d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d</serial>
Aug 27 05:23:58 user nova-compute[72904]: </disk>
Aug 27 05:23:58 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] No VIF found with MAC fa:16:3e:c7:0a:42, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:23:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-32d75fa3-f9a5-49c4-b246-b45423c8b7c3 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.787s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:00 user nova-compute[72904]: INFO nova.compute.manager [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Detaching volume d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d
Aug 27 05:24:00 user nova-compute[72904]: INFO nova.virt.block_device [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Attempting to driver detach volume d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d from mountpoint /dev/vdb
Aug 27 05:24:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Attempting to detach device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:24:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:24:00 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:24:00 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:24:00 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:24:00 user nova-compute[72904]:   <serial>d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d</serial>
Aug 27 05:24:00 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:24:00 user nova-compute[72904]: </disk>
Aug 27 05:24:00 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:24:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the persistent domain config.
Aug 27 05:24:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:24:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:24:00 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:24:00 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:24:00 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:24:00 user nova-compute[72904]:   <serial>d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d</serial>
Aug 27 05:24:00 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:24:00 user nova-compute[72904]: </disk>
Aug 27 05:24:00 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693113841.3318355, f88b1d96-56b7-4595-af27-50993d25d527 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:24:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully detached device vdb from instance f88b1d96-56b7-4595-af27-50993d25d527 from the live domain config.
Aug 27 05:24:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CobVunqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:24:01 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a6e57-fb12-49b3-9fe6-e4249b3d1eee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd33628-5878-4033-9212-46764c8ee620]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:01 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:01 user nova-compute[72904]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d (non-flash)
Aug 27 05:24:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:01 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:01 user nova-compute[72904]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d (non-flash)
Aug 27 05:24:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194465f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0842f2d0-a01c-4a58-b3dd-04ec5bf1a454]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cbd82c-9ae5-4595-a5e4-007932e0f621]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a4d01-4719-46da-a341-624903cb4aef]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9706bd5a-bded-47d0-baba-b3b08c711ee2]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a53cdd-5184-44f6-ac90-a87139f6c6b1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92e2a68-08ba-4746-97c5-3ec3f5b5504e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260]
Aug 27 05:24:01 user nova-compute[72904]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d, portal: 172.16.0.220,3260] successful.
Aug 27 05:24:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d49cd87a-8a2d-4bc6-9d9f-c37fe431b20d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1649f37c-538d-4fca-9ab4-62f9fccb8ee6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] <== disconnect_volume: return (277ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:24:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:24:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:02 user nova-compute[72904]: DEBUG nova.objects.instance [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'flavor' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-13ae49b1-db25-48e0-ad52-141453de7cfd tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'pci_requests' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'numa_topology' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:24:08 user nova-compute[72904]: INFO nova.compute.claims [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Claim successful on node user
Aug 27 05:24:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:24:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:08 user nova-compute[72904]: INFO nova.network.neutron [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating port c83b0b06-36a4-4822-8922-8a36c443aa85 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing instance network info cache due to event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:24:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Creating image(s)
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Ensure instance console log exists: /opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Start _get_guest_xml network_info=[{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e5437b05-0f1b-4146-89b1-43f6de4b7369', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2d438f2-0630-4fab-9eab-f00276a01949', 'attached_at': '', 'detached_at': '', 'volume_id': '81633978-c3ab-4770-98d8-e207b4f7992b', 'serial': '81633978-c3ab-4770-98d8-e207b4f7992b'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.network.neutron [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:24:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:24:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:24:09 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG nova.objects.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Object Instance<c2d438f2-0630-4fab-9eab-f00276a01949> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:24:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:24:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:24:10 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b52d1e-ce9e-482b-854b-85ebeb861f28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:24:10 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daffaa9-68e3-4acf-a7f3-c690ac0d5bcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b] added
Aug 27 05:24:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d1f01-bf2a-4050-b7df-531f53e67548]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[baefefea-4a1d-4a30-873c-c8e8e4e572b2]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKpCuJn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwKpCuJn" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0d2f34-98d9-4db7-919b-2ac5695c7575]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwKpCuJn'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a526b-4f65-43ab-a64b-f0dde263cede]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d668db-8ee6-4ff0-ac82-bda621adc9fb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:10 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:10 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[199836a0-5644-412b-8b61-73547fa8889c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]
Aug 27 05:24:10 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.
Aug 27 05:24:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e8b59-e94f-42a1-a113-538a6c1868d1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[97952a3d-f5fa-4135-9be3-2b847f5f450e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:10 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:10 user nova-compute[72904]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:24:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:10 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:10 user nova-compute[72904]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:24:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[24edcf36-78b6-41fe-bd79-e765d740c59c]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updated VIF entry in instance network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b8340531-c98d-4f39-8cde-af009505a605 req-014696c3-a7de-4368-8f34-b5c16fc1e048 service nova] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23237353533386630', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237353533386630', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-877479218',display_name='tempest-TestShelveInstance-server-877479218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-877479218',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1274547691',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='508d0e5f51934ac9ad219665714ad215',ramdisk_id='',reservation_id='r-lrjlnj1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-863084300',owner_user_name='tempest-TestShelveInstance-863084300-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:23:56Z,user_data=None,user_id='aff961cb4ba4410fb4c7fba4ca907779',uuid=c2d438f2-0630-4fab-9eab-f00276a01949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converting VIF {"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'pci_devices' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.objects.base [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Object Instance<c2d438f2-0630-4fab-9eab-f00276a01949> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=72904) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:24:11 user nova-compute[72904]:   <uuid>c2d438f2-0630-4fab-9eab-f00276a01949</uuid>
Aug 27 05:24:11 user nova-compute[72904]:   <name>instance-00000025</name>
Aug 27 05:24:11 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:24:11 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:24:11 user nova-compute[72904]:   <metadata>
Aug 27 05:24:11 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:24:11 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:24:11 user nova-compute[72904]:       <nova:name>tempest-TestShelveInstance-server-877479218</nova:name>
Aug 27 05:24:11 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:24:09</nova:creationTime>
Aug 27 05:24:11 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:24:11 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:24:11 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:24:11 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:24:11 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:24:11 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:24:11 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:24:11 user nova-compute[72904]:       <nova:owner>
Aug 27 05:24:11 user nova-compute[72904]:         <nova:user uuid="aff961cb4ba4410fb4c7fba4ca907779">tempest-TestShelveInstance-863084300-project-member</nova:user>
Aug 27 05:24:11 user nova-compute[72904]:         <nova:project uuid="508d0e5f51934ac9ad219665714ad215">tempest-TestShelveInstance-863084300</nova:project>
Aug 27 05:24:11 user nova-compute[72904]:       </nova:owner>
Aug 27 05:24:11 user nova-compute[72904]:       <nova:ports>
Aug 27 05:24:11 user nova-compute[72904]:         <nova:port uuid="c83b0b06-36a4-4822-8922-8a36c443aa85">
Aug 27 05:24:11 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:24:11 user nova-compute[72904]:         </nova:port>
Aug 27 05:24:11 user nova-compute[72904]:       </nova:ports>
Aug 27 05:24:11 user nova-compute[72904]:     </nova:instance>
Aug 27 05:24:11 user nova-compute[72904]:   </metadata>
Aug 27 05:24:11 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:24:11 user nova-compute[72904]:     <system>
Aug 27 05:24:11 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:24:11 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:24:11 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:24:11 user nova-compute[72904]:       <entry name="serial">c2d438f2-0630-4fab-9eab-f00276a01949</entry>
Aug 27 05:24:11 user nova-compute[72904]:       <entry name="uuid">c2d438f2-0630-4fab-9eab-f00276a01949</entry>
Aug 27 05:24:11 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:24:11 user nova-compute[72904]:     </system>
Aug 27 05:24:11 user nova-compute[72904]:   </sysinfo>
Aug 27 05:24:11 user nova-compute[72904]:   <os>
Aug 27 05:24:11 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:24:11 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:24:11 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:24:11 user nova-compute[72904]:   </os>
Aug 27 05:24:11 user nova-compute[72904]:   <features>
Aug 27 05:24:11 user nova-compute[72904]:     <acpi/>
Aug 27 05:24:11 user nova-compute[72904]:     <apic/>
Aug 27 05:24:11 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:24:11 user nova-compute[72904]:   </features>
Aug 27 05:24:11 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:24:11 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:24:11 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:24:11 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:24:11 user nova-compute[72904]:   </clock>
Aug 27 05:24:11 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:24:11 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:24:11 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:24:11 user nova-compute[72904]:   </cpu>
Aug 27 05:24:11 user nova-compute[72904]:   <devices>
Aug 27 05:24:11 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:24:11 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:24:11 user nova-compute[72904]:       <source dev="/dev/sdd"/>
Aug 27 05:24:11 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:24:11 user nova-compute[72904]:       <serial>81633978-c3ab-4770-98d8-e207b4f7992b</serial>
Aug 27 05:24:11 user nova-compute[72904]:     </disk>
Aug 27 05:24:11 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:24:11 user nova-compute[72904]:       <mac address="fa:16:3e:a2:d8:be"/>
Aug 27 05:24:11 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:24:11 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:24:11 user nova-compute[72904]:       <target dev="tapc83b0b06-36"/>
Aug 27 05:24:11 user nova-compute[72904]:     </interface>
Aug 27 05:24:11 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:24:11 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949/console.log" append="off"/>
Aug 27 05:24:11 user nova-compute[72904]:     </serial>
Aug 27 05:24:11 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:24:11 user nova-compute[72904]:     <video>
Aug 27 05:24:11 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:24:11 user nova-compute[72904]:     </video>
Aug 27 05:24:11 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:24:11 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:24:11 user nova-compute[72904]:     </rng>
Aug 27 05:24:11 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:24:11 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:24:11 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:24:11 user nova-compute[72904]:     </memballoon>
Aug 27 05:24:11 user nova-compute[72904]:   </devices>
Aug 27 05:24:11 user nova-compute[72904]: </domain>
Aug 27 05:24:11 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-877479218',display_name='tempest-TestShelveInstance-server-877479218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-877479218',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1274547691',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:20:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='508d0e5f51934ac9ad219665714ad215',ramdisk_id='',reservation_id='r-lrjlnj1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-863084300',owner_user_name='tempest-TestShelveInstance-863084300-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:23:56Z,user_data=None,user_id='aff961cb4ba4410fb4c7fba4ca907779',uuid=c2d438f2-0630-4fab-9eab-f00276a01949,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converting VIF {"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG os_vif [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83b0b06-36, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc83b0b06-36, col_values=(('external_ids', {'iface-id': 'c83b0b06-36a4-4822-8922-8a36c443aa85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:d8:be', 'vm-uuid': 'c2d438f2-0630-4fab-9eab-f00276a01949'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:11 user nova-compute[72904]: INFO os_vif [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36')
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:24:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] No VIF found with MAC fa:16:3e:a2:d8:be, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:24:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-efdae6ac-ef5c-4712-8f83-804690bd9218 req-04a23490-2daa-4cad-a0d8-764c9ba42219 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-efdae6ac-ef5c-4712-8f83-804690bd9218 req-04a23490-2daa-4cad-a0d8-764c9ba42219 service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-efdae6ac-ef5c-4712-8f83-804690bd9218 req-04a23490-2daa-4cad-a0d8-764c9ba42219 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-efdae6ac-ef5c-4712-8f83-804690bd9218 req-04a23490-2daa-4cad-a0d8-764c9ba42219 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG nova.compute.manager [req-efdae6ac-ef5c-4712-8f83-804690bd9218 req-04a23490-2daa-4cad-a0d8-764c9ba42219 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:24:13 user nova-compute[72904]: WARNING nova.compute.manager [req-efdae6ac-ef5c-4712-8f83-804690bd9218 req-04a23490-2daa-4cad-a0d8-764c9ba42219 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received unexpected event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 27 05:24:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113855.0430894, c2d438f2-0630-4fab-9eab-f00276a01949 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:24:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] VM Resumed (Lifecycle Event)
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:24:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance spawned successfully.
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:24:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113855.0446105, c2d438f2-0630-4fab-9eab-f00276a01949 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:24:15 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] VM Started (Lifecycle Event)
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ac8aa67a-4ac3-4947-b26e-21345658d07c tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.345s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-77f3cff7-d84a-46df-aba1-4f4633829a5c req-a6233221-03bb-4e8b-b98d-97ae6636f291 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-77f3cff7-d84a-46df-aba1-4f4633829a5c req-a6233221-03bb-4e8b-b98d-97ae6636f291 service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-77f3cff7-d84a-46df-aba1-4f4633829a5c req-a6233221-03bb-4e8b-b98d-97ae6636f291 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-77f3cff7-d84a-46df-aba1-4f4633829a5c req-a6233221-03bb-4e8b-b98d-97ae6636f291 service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-77f3cff7-d84a-46df-aba1-4f4633829a5c req-a6233221-03bb-4e8b-b98d-97ae6636f291 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:24:15 user nova-compute[72904]: WARNING nova.compute.manager [req-77f3cff7-d84a-46df-aba1-4f4633829a5c req-a6233221-03bb-4e8b-b98d-97ae6636f291 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received unexpected event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with vm_state active and task_state None.
Aug 27 05:24:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:23 user nova-compute[72904]: INFO nova.compute.manager [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Terminating instance
Aug 27 05:24:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Instance destroyed successfully.
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.objects.instance [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'resources' on Instance uuid 811276f1-7d8e-4b92-9cb0-239ad4121cff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179411322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179411322',id=22,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:10:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-ifzy4j22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:12:21Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=811276f1-7d8e-4b92-9cb0-239ad4121cff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "address": "fa:16:3e:31:19:c7", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e518d8-3b", "ovs_interfaceid": "14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_vif [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14e518d8-3b, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:24 user nova-compute[72904]: INFO os_vif [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:19:c7,bridge_name='br-int',has_traffic_filtering=True,id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e518d8-3b')
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUOVWiwm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:24:24 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dc6b7a-8a29-4e15-8f17-721a67d03134]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa434fa-44ca-4076-99fe-872e02c1008d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:24 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:24 user nova-compute[72904]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:24:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb (non-flash)
Aug 27 05:24:24 user nova-compute[72904]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:24 user nova-compute[72904]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:24:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c687880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb'): ({'sdc'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Removing single pathed devices sdc {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaaf310-574c-44b9-8e32-50b07b18b464]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a15092-7040-4fa0-8f04-a183344bb0ab]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Flushing IO for device /dev/sdc {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3573a47-52da-4222-ab5d-5b11a656c736]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed836dc6-a3d7-4f74-bdf5-a21c8156f672]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3925de-8cf7-46fd-82fb-79471c311abb]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7eb4f7-698f-4495-aed6-86248e8a6b41]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260]
Aug 27 05:24:24 user nova-compute[72904]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb, portal: 172.16.0.220,3260] successful.
Aug 27 05:24:24 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88473f29-16df-48ce-aa93-4488a695edeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa8e8a-576a-464f-9962-4b9621242935]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] <== disconnect_volume: return (280ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:24:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Deleting instance files /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff_del
Aug 27 05:24:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Deletion of /opt/stack/data/nova/instances/811276f1-7d8e-4b92-9cb0-239ad4121cff_del complete
Aug 27 05:24:24 user nova-compute[72904]: INFO nova.compute.manager [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 05:24:24 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:24:24 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:24:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:25 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:25 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Took 0.60 seconds to deallocate network for instance.
Aug 27 05:24:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-822847a7-11e3-4bec-9098-0a03b1bbbd06 req-ec4ca794-16bc-4127-bafd-e04edb410a88 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Received event network-vif-deleted-14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:25 user nova-compute[72904]: INFO nova.compute.manager [req-822847a7-11e3-4bec-9098-0a03b1bbbd06 req-ec4ca794-16bc-4127-bafd-e04edb410a88 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Neutron deleted interface 14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6; detaching it from the instance and deleting it from the info cache
Aug 27 05:24:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-822847a7-11e3-4bec-9098-0a03b1bbbd06 req-ec4ca794-16bc-4127-bafd-e04edb410a88 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-822847a7-11e3-4bec-9098-0a03b1bbbd06 req-ec4ca794-16bc-4127-bafd-e04edb410a88 service nova] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Detach interface failed, port_id=14e518d8-3b85-4df9-bbbd-48ebb2fbcfb6, reason: Instance 811276f1-7d8e-4b92-9cb0-239ad4121cff could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:24:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:24:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:24:30 user nova-compute[72904]: INFO nova.compute.claims [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Claim successful on node user
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:24:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.policy [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad789d010e2f46d9b327fc2db624c241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e827a16ef56e4530b4ac80472befef1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:24:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Creating image(s)
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "/opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "/opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk 1073741824" returned: 0 in 0.056s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Successfully created port: b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:24:32 user nova-compute[72904]: INFO nova.compute.manager [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Took 7.07 seconds to detach 1 volumes for instance.
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Cannot resize image /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Ensure instance console log exists: /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:32 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Deleted allocations for instance 811276f1-7d8e-4b92-9cb0-239ad4121cff
Aug 27 05:24:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-34c5b766-f53d-483a-95ac-7ccfd1576283 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "811276f1-7d8e-4b92-9cb0-239ad4121cff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.376s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Successfully updated port: b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquired lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-changed-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Refreshing instance network info cache due to event network-changed-b1ff6156-a160-4501-bc49-719d95d1c280. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] Acquiring lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updating instance_info_cache with network_info: [{"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Releasing lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Instance network_info: |[{"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] Acquired lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Refreshing network info cache for port b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Start _get_guest_xml network_info=[{"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:24:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:24:33 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-754453068',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-754453068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7544530',id=38,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDr+8WpN2NOfB8zkdK+hPpKH62R8foUa4fYk2RJ5rg4kUd+sEMY3x8eh4DaVFRI4qGeBzkHw4bx+qZEgSxKwETqXJrSg3fFznuPQgwrzvYJwaqZqdIoacxwZv8iPA36cQ==',key_name='tempest-keypair-1291554012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e827a16ef56e4530b4ac80472befef1a',ramdisk_id='',reservation_id='r-m8gl7pac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1414241050',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad789d010e2f46d9b327fc2db624c241',uuid=bd0ea36f-1c42-426f-8d8f-4407b655f523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Converting VIF {"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=b1ff6156-a160-4501-bc49-719d95d1c280,network=Network(f4ebee8a-7a14-4b76-b963-1c480841f2e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ff6156-a1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.objects.instance [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lazy-loading 'pci_devices' on Instance uuid bd0ea36f-1c42-426f-8d8f-4407b655f523 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:24:33 user nova-compute[72904]:   <uuid>bd0ea36f-1c42-426f-8d8f-4407b655f523</uuid>
Aug 27 05:24:33 user nova-compute[72904]:   <name>instance-00000026</name>
Aug 27 05:24:33 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:24:33 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:24:33 user nova-compute[72904]:   <metadata>
Aug 27 05:24:33 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:24:33 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:24:33 user nova-compute[72904]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-754453068</nova:name>
Aug 27 05:24:33 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:24:33</nova:creationTime>
Aug 27 05:24:33 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:24:33 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:24:33 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:24:33 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:24:33 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:24:33 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:24:33 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:24:33 user nova-compute[72904]:       <nova:owner>
Aug 27 05:24:33 user nova-compute[72904]:         <nova:user uuid="ad789d010e2f46d9b327fc2db624c241">tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member</nova:user>
Aug 27 05:24:33 user nova-compute[72904]:         <nova:project uuid="e827a16ef56e4530b4ac80472befef1a">tempest-TestServerVolumeAttachScenarioOldVersion-1414241050</nova:project>
Aug 27 05:24:33 user nova-compute[72904]:       </nova:owner>
Aug 27 05:24:33 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:24:33 user nova-compute[72904]:       <nova:ports>
Aug 27 05:24:33 user nova-compute[72904]:         <nova:port uuid="b1ff6156-a160-4501-bc49-719d95d1c280">
Aug 27 05:24:33 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 05:24:33 user nova-compute[72904]:         </nova:port>
Aug 27 05:24:33 user nova-compute[72904]:       </nova:ports>
Aug 27 05:24:33 user nova-compute[72904]:     </nova:instance>
Aug 27 05:24:33 user nova-compute[72904]:   </metadata>
Aug 27 05:24:33 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:24:33 user nova-compute[72904]:     <system>
Aug 27 05:24:33 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:24:33 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:24:33 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:24:33 user nova-compute[72904]:       <entry name="serial">bd0ea36f-1c42-426f-8d8f-4407b655f523</entry>
Aug 27 05:24:33 user nova-compute[72904]:       <entry name="uuid">bd0ea36f-1c42-426f-8d8f-4407b655f523</entry>
Aug 27 05:24:33 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:24:33 user nova-compute[72904]:     </system>
Aug 27 05:24:33 user nova-compute[72904]:   </sysinfo>
Aug 27 05:24:33 user nova-compute[72904]:   <os>
Aug 27 05:24:33 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:24:33 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:24:33 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:24:33 user nova-compute[72904]:   </os>
Aug 27 05:24:33 user nova-compute[72904]:   <features>
Aug 27 05:24:33 user nova-compute[72904]:     <acpi/>
Aug 27 05:24:33 user nova-compute[72904]:     <apic/>
Aug 27 05:24:33 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:24:33 user nova-compute[72904]:   </features>
Aug 27 05:24:33 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:24:33 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:24:33 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:24:33 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:24:33 user nova-compute[72904]:   </clock>
Aug 27 05:24:33 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:24:33 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:24:33 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:24:33 user nova-compute[72904]:   </cpu>
Aug 27 05:24:33 user nova-compute[72904]:   <devices>
Aug 27 05:24:33 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:24:33 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:24:33 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk"/>
Aug 27 05:24:33 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:24:33 user nova-compute[72904]:     </disk>
Aug 27 05:24:33 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:24:33 user nova-compute[72904]:       <mac address="fa:16:3e:24:91:1f"/>
Aug 27 05:24:33 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:24:33 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:24:33 user nova-compute[72904]:       <target dev="tapb1ff6156-a1"/>
Aug 27 05:24:33 user nova-compute[72904]:     </interface>
Aug 27 05:24:33 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:24:33 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/console.log" append="off"/>
Aug 27 05:24:33 user nova-compute[72904]:     </serial>
Aug 27 05:24:33 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:24:33 user nova-compute[72904]:     <video>
Aug 27 05:24:33 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:24:33 user nova-compute[72904]:     </video>
Aug 27 05:24:33 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:24:33 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:24:33 user nova-compute[72904]:     </rng>
Aug 27 05:24:33 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:24:33 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:24:33 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:24:33 user nova-compute[72904]:     </memballoon>
Aug 27 05:24:33 user nova-compute[72904]:   </devices>
Aug 27 05:24:33 user nova-compute[72904]: </domain>
Aug 27 05:24:33 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-754453068',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-754453068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7544530',id=38,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDr+8WpN2NOfB8zkdK+hPpKH62R8foUa4fYk2RJ5rg4kUd+sEMY3x8eh4DaVFRI4qGeBzkHw4bx+qZEgSxKwETqXJrSg3fFznuPQgwrzvYJwaqZqdIoacxwZv8iPA36cQ==',key_name='tempest-keypair-1291554012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e827a16ef56e4530b4ac80472befef1a',ramdisk_id='',reservation_id='r-m8gl7pac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1414241050',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:24:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad789d010e2f46d9b327fc2db624c241',uuid=bd0ea36f-1c42-426f-8d8f-4407b655f523,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Converting VIF {"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=b1ff6156-a160-4501-bc49-719d95d1c280,network=Network(f4ebee8a-7a14-4b76-b963-1c480841f2e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ff6156-a1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG os_vif [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=b1ff6156-a160-4501-bc49-719d95d1c280,network=Network(f4ebee8a-7a14-4b76-b963-1c480841f2e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ff6156-a1') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1ff6156-a1, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1ff6156-a1, col_values=(('external_ids', {'iface-id': 'b1ff6156-a160-4501-bc49-719d95d1c280', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:91:1f', 'vm-uuid': 'bd0ea36f-1c42-426f-8d8f-4407b655f523'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:24:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:33 user nova-compute[72904]: INFO os_vif [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=b1ff6156-a160-4501-bc49-719d95d1c280,network=Network(f4ebee8a-7a14-4b76-b963-1c480841f2e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ff6156-a1')
Aug 27 05:24:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:24:34 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] No VIF found with MAC fa:16:3e:24:91:1f, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:24:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updated VIF entry in instance network info cache for port b1ff6156-a160-4501-bc49-719d95d1c280. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:24:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updating instance_info_cache with network_info: [{"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-08299681-6717-44ec-9e9c-7e715a8871ba req-ed4d47a6-5554-4dfd-bd81-e615759b0668 service nova] Releasing lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-dd1b9344-01fa-4a5d-899f-71044bfd7ab4 req-07fa826c-69d0-40bc-99df-e0b154aca0aa service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dd1b9344-01fa-4a5d-899f-71044bfd7ab4 req-07fa826c-69d0-40bc-99df-e0b154aca0aa service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dd1b9344-01fa-4a5d-899f-71044bfd7ab4 req-07fa826c-69d0-40bc-99df-e0b154aca0aa service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dd1b9344-01fa-4a5d-899f-71044bfd7ab4 req-07fa826c-69d0-40bc-99df-e0b154aca0aa service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-dd1b9344-01fa-4a5d-899f-71044bfd7ab4 req-07fa826c-69d0-40bc-99df-e0b154aca0aa service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:24:35 user nova-compute[72904]: WARNING nova.compute.manager [req-dd1b9344-01fa-4a5d-899f-71044bfd7ab4 req-07fa826c-69d0-40bc-99df-e0b154aca0aa service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received unexpected event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with vm_state building and task_state spawning.
Aug 27 05:24:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113877.2331903, bd0ea36f-1c42-426f-8d8f-4407b655f523 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:24:37 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] VM Resumed (Lifecycle Event)
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:24:37 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Instance spawned successfully.
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:24:37 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113877.2344987, bd0ea36f-1c42-426f-8d8f-4407b655f523 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:24:37 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] VM Started (Lifecycle Event)
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:24:37 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:24:37 user nova-compute[72904]: INFO nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-030e1005-d00b-4bc2-9a5d-6c7f6850b937 req-5feac4aa-1763-4e94-98f9-6441369ae25b service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-030e1005-d00b-4bc2-9a5d-6c7f6850b937 req-5feac4aa-1763-4e94-98f9-6441369ae25b service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-030e1005-d00b-4bc2-9a5d-6c7f6850b937 req-5feac4aa-1763-4e94-98f9-6441369ae25b service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-030e1005-d00b-4bc2-9a5d-6c7f6850b937 req-5feac4aa-1763-4e94-98f9-6441369ae25b service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-030e1005-d00b-4bc2-9a5d-6c7f6850b937 req-5feac4aa-1763-4e94-98f9-6441369ae25b service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:24:37 user nova-compute[72904]: WARNING nova.compute.manager [req-030e1005-d00b-4bc2-9a5d-6c7f6850b937 req-5feac4aa-1763-4e94-98f9-6441369ae25b service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received unexpected event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with vm_state building and task_state spawning.
Aug 27 05:24:37 user nova-compute[72904]: INFO nova.compute.manager [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Took 6.49 seconds to build instance.
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-d933feac-1a63-4647-b82b-4b03e9444c96 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.581s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:24:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113864.1487684, 811276f1-7d8e-4b92-9cb0-239ad4121cff => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:24:39 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] VM Stopped (Lifecycle Event)
Aug 27 05:24:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-191d161e-9871-4775-9397-dcff93cbf73d None None] [instance: 811276f1-7d8e-4b92-9cb0-239ad4121cff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:39 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:24:39 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:24:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8018MB free_disk=25.27672576904297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 4fba85dc-5514-4bc1-a731-1cd1af6da152 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c2d438f2-0630-4fab-9eab-f00276a01949 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bd0ea36f-1c42-426f-8d8f-4407b655f523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:24:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:24:45 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:24:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:24:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:24:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:24:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [{"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-12da6d24-08c6-4b62-bef3-3dbc05b28020" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:24:46 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:24:46 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:47 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 4fba85dc-5514-4bc1-a731-1cd1af6da152 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 12da6d24-08c6-4b62-bef3-3dbc05b28020 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid bd0ea36f-1c42-426f-8d8f-4407b655f523 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:52 user nova-compute[72904]: INFO nova.compute.manager [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Terminating instance
Aug 27 05:24:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-88f3381a-0715-4934-b9fc-d515a4337561 req-5548515e-4b2d-4bbd-9170-a59eb6e2798d service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-unplugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-88f3381a-0715-4934-b9fc-d515a4337561 req-5548515e-4b2d-4bbd-9170-a59eb6e2798d service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-88f3381a-0715-4934-b9fc-d515a4337561 req-5548515e-4b2d-4bbd-9170-a59eb6e2798d service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-88f3381a-0715-4934-b9fc-d515a4337561 req-5548515e-4b2d-4bbd-9170-a59eb6e2798d service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-88f3381a-0715-4934-b9fc-d515a4337561 req-5548515e-4b2d-4bbd-9170-a59eb6e2798d service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-unplugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-88f3381a-0715-4934-b9fc-d515a4337561 req-5548515e-4b2d-4bbd-9170-a59eb6e2798d service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-unplugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:53 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Instance destroyed successfully.
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'resources' on Instance uuid 12da6d24-08c6-4b62-bef3-3dbc05b28020 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1439837580',display_name='tempest-ServerActionsTestOtherA-server-1439837580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1439837580',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-fq2wl9pq',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=12da6d24-08c6-4b62-bef3-3dbc05b28020,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "address": "fa:16:3e:ad:28:f1", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13955c19-f1", "ovs_interfaceid": "13955c19-f1f4-466c-8e3a-5ccf423b2569", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_vif [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13955c19-f1, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:24:53 user nova-compute[72904]: INFO os_vif [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:28:f1,bridge_name='br-int',has_traffic_filtering=True,id=13955c19-f1f4-466c-8e3a-5ccf423b2569,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13955c19-f1')
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noNWRVwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:24:53 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2281926-c9bb-4d59-bc43-1698c41be852]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0249cf97-45a1-4b97-ac83-ec379d70ac85]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:53 user nova-compute[72904]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:24:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 (non-flash)
Aug 27 05:24:53 user nova-compute[72904]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:24:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c641900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.110s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77623a6-1bed-44d4-bdf3-6b07307abd6f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e8c70e-ecfd-40f0-b2d9-526076c95933]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3fd94-3171-43b9-ae29-3b1dcfe8fd85]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03d250-7218-48f6-a6bb-9d89f9a5326e]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf60575-c948-4d73-a195-0220a62dcd8c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[373edecd-44e1-48df-8ce7-cb55f13ffb29]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260]
Aug 27 05:24:53 user nova-compute[72904]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7, portal: 172.16.0.220,3260] successful.
Aug 27 05:24:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[829893b5-ba90-4499-8292-fd78fe9b608b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] <== disconnect_volume: return (396ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:24:53 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:24:53 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Deleting instance files /opt/stack/data/nova/instances/12da6d24-08c6-4b62-bef3-3dbc05b28020_del
Aug 27 05:24:53 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Deletion of /opt/stack/data/nova/instances/12da6d24-08c6-4b62-bef3-3dbc05b28020_del complete
Aug 27 05:24:54 user nova-compute[72904]: INFO nova.compute.manager [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 27 05:24:54 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:24:54 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:24:54 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:24:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:54 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:54 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Took 0.95 seconds to deallocate network for instance.
Aug 27 05:24:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-f698532d-3d87-4ccb-8e5e-d547abe30a7b req-cd6f2f4c-0037-4d3a-8760-a44ab3fac19c service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-deleted-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:54 user nova-compute[72904]: INFO nova.compute.manager [req-f698532d-3d87-4ccb-8e5e-d547abe30a7b req-cd6f2f4c-0037-4d3a-8760-a44ab3fac19c service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Neutron deleted interface 13955c19-f1f4-466c-8e3a-5ccf423b2569; detaching it from the instance and deleting it from the info cache
Aug 27 05:24:54 user nova-compute[72904]: DEBUG nova.network.neutron [req-f698532d-3d87-4ccb-8e5e-d547abe30a7b req-cd6f2f4c-0037-4d3a-8760-a44ab3fac19c service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:24:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-f698532d-3d87-4ccb-8e5e-d547abe30a7b req-cd6f2f4c-0037-4d3a-8760-a44ab3fac19c service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Detach interface failed, port_id=13955c19-f1f4-466c-8e3a-5ccf423b2569, reason: Instance 12da6d24-08c6-4b62-bef3-3dbc05b28020 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:24:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-1dcd707c-fcba-4c8d-8af4-b41252c68989 req-967366e7-e58f-42ae-bc16-8761aa513750 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:24:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1dcd707c-fcba-4c8d-8af4-b41252c68989 req-967366e7-e58f-42ae-bc16-8761aa513750 service nova] Acquiring lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1dcd707c-fcba-4c8d-8af4-b41252c68989 req-967366e7-e58f-42ae-bc16-8761aa513750 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1dcd707c-fcba-4c8d-8af4-b41252c68989 req-967366e7-e58f-42ae-bc16-8761aa513750 service nova] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-1dcd707c-fcba-4c8d-8af4-b41252c68989 req-967366e7-e58f-42ae-bc16-8761aa513750 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] No waiting events found dispatching network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:24:55 user nova-compute[72904]: WARNING nova.compute.manager [req-1dcd707c-fcba-4c8d-8af4-b41252c68989 req-967366e7-e58f-42ae-bc16-8761aa513750 service nova] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Received unexpected event network-vif-plugged-13955c19-f1f4-466c-8e3a-5ccf423b2569 for instance with vm_state active and task_state deleting.
Aug 27 05:24:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:58 user nova-compute[72904]: INFO nova.compute.manager [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Took 3.28 seconds to detach 1 volumes for instance.
Aug 27 05:24:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Deleting volume: ea1cbb08-6b6b-42af-b6d5-54c76ce769d7 {{(pid=72904) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 05:24:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:24:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:24:58 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:24:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:24:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:24:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:24:58 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Deleted allocations for instance 12da6d24-08c6-4b62-bef3-3dbc05b28020
Aug 27 05:24:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1531c894-6cbc-435c-9ccf-22e7238b93dc tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "12da6d24-08c6-4b62-bef3-3dbc05b28020" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.949s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:25:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:08 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113893.5110097, 12da6d24-08c6-4b62-bef3-3dbc05b28020 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:25:08 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] VM Stopped (Lifecycle Event)
Aug 27 05:25:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-2b247eda-aea6-4af8-bc30-e5741d44fb26 None None] [instance: 12da6d24-08c6-4b62-bef3-3dbc05b28020] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:25:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:14 user nova-compute[72904]: INFO nova.compute.manager [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Terminating instance
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-f2d39c89-9e70-4707-be5a-9367a21316fe req-103118d7-b8f7-45af-b691-cd88bb168418 service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received event network-vif-unplugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f2d39c89-9e70-4707-be5a-9367a21316fe req-103118d7-b8f7-45af-b691-cd88bb168418 service nova] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f2d39c89-9e70-4707-be5a-9367a21316fe req-103118d7-b8f7-45af-b691-cd88bb168418 service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f2d39c89-9e70-4707-be5a-9367a21316fe req-103118d7-b8f7-45af-b691-cd88bb168418 service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-f2d39c89-9e70-4707-be5a-9367a21316fe req-103118d7-b8f7-45af-b691-cd88bb168418 service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] No waiting events found dispatching network-vif-unplugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-f2d39c89-9e70-4707-be5a-9367a21316fe req-103118d7-b8f7-45af-b691-cd88bb168418 service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received event network-vif-unplugged-a99493e7-a32a-4126-ba01-7563e74bb14d for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Instance destroyed successfully.
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.objects.instance [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lazy-loading 'resources' on Instance uuid 4fba85dc-5514-4bc1-a731-1cd1af6da152 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:04:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1383886142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1383886142',id=15,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:04:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da9ae29302d54f8aa82e6c51bbfba65d',ramdisk_id='',reservation_id='r-5pyri6ck',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:06:42Z,user_data=None,user_id='f4bbded3a71e4d6196d83c1fa5e7a868',uuid=4fba85dc-5514-4bc1-a731-1cd1af6da152,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converting VIF {"id": "a99493e7-a32a-4126-ba01-7563e74bb14d", "address": "fa:16:3e:00:94:30", "network": {"id": "0cda2628-e67c-48b5-acf3-b1602318e2b5", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-742762011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da9ae29302d54f8aa82e6c51bbfba65d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa99493e7-a3", "ovs_interfaceid": "a99493e7-a32a-4126-ba01-7563e74bb14d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:94:30,bridge_name='br-int',has_traffic_filtering=True,id=a99493e7-a32a-4126-ba01-7563e74bb14d,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99493e7-a3') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG os_vif [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:94:30,bridge_name='br-int',has_traffic_filtering=True,id=a99493e7-a32a-4126-ba01-7563e74bb14d,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99493e7-a3') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa99493e7-a3, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:14 user nova-compute[72904]: INFO os_vif [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:94:30,bridge_name='br-int',has_traffic_filtering=True,id=a99493e7-a32a-4126-ba01-7563e74bb14d,network=Network(0cda2628-e67c-48b5-acf3-b1602318e2b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa99493e7-a3')
Aug 27 05:25:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Deleting instance files /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152_del
Aug 27 05:25:14 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Deletion of /opt/stack/data/nova/instances/4fba85dc-5514-4bc1-a731-1cd1af6da152_del complete
Aug 27 05:25:14 user nova-compute[72904]: INFO nova.compute.manager [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 05:25:14 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:25:14 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:25:15 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:25:15 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Took 0.92 seconds to deallocate network for instance.
Aug 27 05:25:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-494b404c-9534-48e5-9967-21a1f2a01980 req-bebfb5f2-3301-4368-9694-a288579f8872 service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received event network-vif-deleted-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:16 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Deleted allocations for instance 4fba85dc-5514-4bc1-a731-1cd1af6da152
Aug 27 05:25:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-804875a8-7ae9-4a81-9089-ff15fbaa8a92 tempest-ServerBootFromVolumeStableRescueTest-1493340065 tempest-ServerBootFromVolumeStableRescueTest-1493340065-project-member] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-dcacedc2-9866-452f-833b-3623ae892406 req-a14c88bd-94c9-4b58-8529-a4f02478223d service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received event network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dcacedc2-9866-452f-833b-3623ae892406 req-a14c88bd-94c9-4b58-8529-a4f02478223d service nova] Acquiring lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dcacedc2-9866-452f-833b-3623ae892406 req-a14c88bd-94c9-4b58-8529-a4f02478223d service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-dcacedc2-9866-452f-833b-3623ae892406 req-a14c88bd-94c9-4b58-8529-a4f02478223d service nova] Lock "4fba85dc-5514-4bc1-a731-1cd1af6da152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-dcacedc2-9866-452f-833b-3623ae892406 req-a14c88bd-94c9-4b58-8529-a4f02478223d service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] No waiting events found dispatching network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:16 user nova-compute[72904]: WARNING nova.compute.manager [req-dcacedc2-9866-452f-833b-3623ae892406 req-a14c88bd-94c9-4b58-8529-a4f02478223d service nova] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Received unexpected event network-vif-plugged-a99493e7-a32a-4126-ba01-7563e74bb14d for instance with vm_state deleted and task_state None.
Aug 27 05:25:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:25:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:25:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:25:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:25:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:29 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113914.807277, 4fba85dc-5514-4bc1-a731-1cd1af6da152 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:25:29 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] VM Stopped (Lifecycle Event)
Aug 27 05:25:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f9e3d7cc-714b-4c92-b6fc-2d3cb8187b84 None None] [instance: 4fba85dc-5514-4bc1-a731-1cd1af6da152] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:25:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:25:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:25:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:25:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:25:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:37 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:37 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:25:37 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:25:37 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:39 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:25:39 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8236MB free_disk=25.372722625732422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f88b1d96-56b7-4595-af27-50993d25d527 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c2d438f2-0630-4fab-9eab-f00276a01949 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bd0ea36f-1c42-426f-8d8f-4407b655f523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:25:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:46 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing instance network info cache due to event network-changed-c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:25:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] Acquiring lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:25:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] Acquired lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:25:46 user nova-compute[72904]: DEBUG nova.network.neutron [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Refreshing network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:47 user nova-compute[72904]: INFO nova.compute.manager [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Terminating instance
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updated VIF entry in instance network info cache for port c83b0b06-36a4-4822-8922-8a36c443aa85. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [{"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-fc9255e9-1969-4f12-8b53-fa64a90a918f req-d44a9f22-2e54-4d4d-9c21-ae76d2c6b970 service nova] Releasing lock "refresh_cache-c2d438f2-0630-4fab-9eab-f00276a01949" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Skipping network cache update for instance because it is being deleted. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:25:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Instance destroyed successfully.
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lazy-loading 'resources' on Instance uuid c2d438f2-0630-4fab-9eab-f00276a01949 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:20:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-877479218',display_name='tempest-TestShelveInstance-server-877479218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-877479218',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO/iPXTu/fu6ydtm7XM3fu0hQRmXBEu08sy3yMGf8dkOC9xCqtIt2kUGIRuyGp5myE1oRLwcSFevSSXAHPtWvdNz9GGnC0v+ntXMXJmNB4jHQzYQawwX8LWHb3RsKXA9Q==',key_name='tempest-TestShelveInstance-1274547691',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='508d0e5f51934ac9ad219665714ad215',ramdisk_id='',reservation_id='r-lrjlnj1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-863084300',owner_user_name='tempest-TestShelveInstance-863084300-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:24:15Z,user_data=None,user_id='aff961cb4ba4410fb4c7fba4ca907779',uuid=c2d438f2-0630-4fab-9eab-f00276a01949,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converting VIF {"id": "c83b0b06-36a4-4822-8922-8a36c443aa85", "address": "fa:16:3e:a2:d8:be", "network": {"id": "f98cdbd2-5eb8-4684-b4bd-1d3b66bad418", "bridge": "br-int", "label": "tempest-TestShelveInstance-708554227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "508d0e5f51934ac9ad219665714ad215", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83b0b06-36", "ovs_interfaceid": "c83b0b06-36a4-4822-8922-8a36c443aa85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_vif [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83b0b06-36, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:25:47 user nova-compute[72904]: INFO os_vif [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:d8:be,bridge_name='br-int',has_traffic_filtering=True,id=c83b0b06-36a4-4822-8922-8a36c443aa85,network=Network(f98cdbd2-5eb8-4684-b4bd-1d3b66bad418),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83b0b06-36')
Aug 27 05:25:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwKpCuJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:25:47 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedb605d-d7bd-44ec-ae29-c759f8bcdd6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4036ba04-d974-4e6e-b765-6daa16d9d65e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:25:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b (non-flash)
Aug 27 05:25:47 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c54d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c518ed5-3f65-435f-9a2c-2a9840b448ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ad102e-6894-4724-aa65-40e0612457ee]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:25:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955488b-0e0b-453a-aaa0-9fbbcfa92fd5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec225e-aa7b-4e4c-aa43-e6f1c01845f3]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO32221dbb-275538f0710a85d4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_32221dbb', '/dev/disk/by-id/scsi-23237353533386630') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb18ba23-7402-4ad7-85bc-1539016acc9e]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5200bb-8d95-4422-ac5f-f27208049b1c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a30824-3813-477e-abe8-6deacf560b47]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260]
Aug 27 05:25:48 user nova-compute[72904]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b, portal: 172.16.0.220,3260] successful.
Aug 27 05:25:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81633978-c3ab-4770-98d8-e207b4f7992b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[91605733-143b-449f-8d95-6ea3c5f01bdb]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] <== disconnect_volume: return (288ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:25:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Deleting instance files /opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949_del
Aug 27 05:25:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Deletion of /opt/stack/data/nova/instances/c2d438f2-0630-4fab-9eab-f00276a01949_del complete
Aug 27 05:25:48 user nova-compute[72904]: INFO nova.compute.manager [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [{"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:48 user nova-compute[72904]: INFO nova.compute.manager [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Terminating instance
Aug 27 05:25:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:25:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:48 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Took 0.74 seconds to deallocate network for instance.
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-unplugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-unplugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-unplugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] Acquiring lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] Lock "c2d438f2-0630-4fab-9eab-f00276a01949-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] No waiting events found dispatching network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:49 user nova-compute[72904]: WARNING nova.compute.manager [req-895ed929-d413-4f58-a184-f0e5d636a28f req-2843e77c-54c3-42cc-9b6c-5a9689c8001b service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received unexpected event network-vif-plugged-c83b0b06-36a4-4822-8922-8a36c443aa85 for instance with vm_state active and task_state deleting.
Aug 27 05:25:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-ee458b8a-faff-445c-aba4-6e7a9009b265 req-3a2620b6-987d-4a6e-9bb3-ea1f729ea7cc service nova] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Received event network-vif-deleted-c83b0b06-36a4-4822-8922-8a36c443aa85 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Instance destroyed successfully.
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.objects.instance [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lazy-loading 'resources' on Instance uuid f88b1d96-56b7-4595-af27-50993d25d527 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:17:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-619566515',display_name='tempest-SnapshotDataIntegrityTests-server-619566515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-619566515',id=35,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQbMAGyEyckNdLs0I2889oD0fwVXnniMPA3C5dt5Jn/px+G+8+47ZufRbPdv723i4wEC/E8+ufDfTBi8xtrt63wQqfGxvFWDTyr9/o1zlPfC+UmJ5SlAM50fyVGJNlwnA==',key_name='tempest-keypair-212068823',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:17:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c656ac523cb9484894dd81447dfd37cc',ramdisk_id='',reservation_id='r-nq5rz96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1219793608',owner_user_name='tempest-SnapshotDataIntegrityTests-1219793608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:17:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59150e064dd54eb88d913d42561ed945',uuid=f88b1d96-56b7-4595-af27-50993d25d527,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Converting VIF {"id": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "address": "fa:16:3e:c7:0a:42", "network": {"id": "e24fb848-8615-4e38-af0e-81584cbd9332", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-380016124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c656ac523cb9484894dd81447dfd37cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69c64a7d-7c", "ovs_interfaceid": "69c64a7d-7c60-4779-a59d-df6a50f043c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:0a:42,bridge_name='br-int',has_traffic_filtering=True,id=69c64a7d-7c60-4779-a59d-df6a50f043c7,network=Network(e24fb848-8615-4e38-af0e-81584cbd9332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c64a7d-7c') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG os_vif [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:0a:42,bridge_name='br-int',has_traffic_filtering=True,id=69c64a7d-7c60-4779-a59d-df6a50f043c7,network=Network(e24fb848-8615-4e38-af0e-81584cbd9332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c64a7d-7c') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69c64a7d-7c, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:49 user nova-compute[72904]: INFO os_vif [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:0a:42,bridge_name='br-int',has_traffic_filtering=True,id=69c64a7d-7c60-4779-a59d-df6a50f043c7,network=Network(e24fb848-8615-4e38-af0e-81584cbd9332),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69c64a7d-7c')
Aug 27 05:25:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Deleting instance files /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527_del
Aug 27 05:25:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Deletion of /opt/stack/data/nova/instances/f88b1d96-56b7-4595-af27-50993d25d527_del complete
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:49 user nova-compute[72904]: INFO nova.compute.manager [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 05:25:49 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f88b1d96-56b7-4595-af27-50993d25d527] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:25:49 user nova-compute[72904]: INFO nova.compute.manager [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Took 0.86 seconds to detach 1 volumes for instance.
Aug 27 05:25:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Deleting volume: 81633978-c3ab-4770-98d8-e207b4f7992b {{(pid=72904) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:50 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Deleted allocations for instance c2d438f2-0630-4fab-9eab-f00276a01949
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cd4751a8-99fc-4056-8a99-5153e462bd38 tempest-TestShelveInstance-863084300 tempest-TestShelveInstance-863084300-project-member] Lock "c2d438f2-0630-4fab-9eab-f00276a01949" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.320s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:25:50 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Took 1.01 seconds to deallocate network for instance.
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:25:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:50 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Deleted allocations for instance f88b1d96-56b7-4595-af27-50993d25d527
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7911418a-11d5-49fe-9fe2-c0672398ce73 tempest-SnapshotDataIntegrityTests-1219793608 tempest-SnapshotDataIntegrityTests-1219793608-project-member] Lock "f88b1d96-56b7-4595-af27-50993d25d527" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.221s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-ff077dce-0a54-45f4-8247-1e981ac97b7b req-854887d8-fa5f-4151-90c8-4f7d76422306 service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received event network-vif-deleted-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received event network-vif-unplugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] No waiting events found dispatching network-vif-unplugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:51 user nova-compute[72904]: WARNING nova.compute.manager [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received unexpected event network-vif-unplugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 for instance with vm_state deleted and task_state None.
Aug 27 05:25:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received event network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] Acquiring lock "f88b1d96-56b7-4595-af27-50993d25d527-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] Lock "f88b1d96-56b7-4595-af27-50993d25d527-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] No waiting events found dispatching network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:51 user nova-compute[72904]: WARNING nova.compute.manager [req-0e8273f5-e290-415b-90e8-abe3170f6def req-3afd66bd-8719-45b2-95a2-04de210c96ec service nova] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Received unexpected event network-vif-plugged-69c64a7d-7c60-4779-a59d-df6a50f043c7 for instance with vm_state deleted and task_state None.
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:52 user nova-compute[72904]: INFO nova.compute.manager [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Terminating instance
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-c3832c44-9aa8-4e6c-a875-0b33aedbcb28 req-5c6da4cb-c6ff-4447-8acb-337fcd631a15 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-vif-unplugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c3832c44-9aa8-4e6c-a875-0b33aedbcb28 req-5c6da4cb-c6ff-4447-8acb-337fcd631a15 service nova] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c3832c44-9aa8-4e6c-a875-0b33aedbcb28 req-5c6da4cb-c6ff-4447-8acb-337fcd631a15 service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c3832c44-9aa8-4e6c-a875-0b33aedbcb28 req-5c6da4cb-c6ff-4447-8acb-337fcd631a15 service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-c3832c44-9aa8-4e6c-a875-0b33aedbcb28 req-5c6da4cb-c6ff-4447-8acb-337fcd631a15 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] No waiting events found dispatching network-vif-unplugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.compute.manager [req-c3832c44-9aa8-4e6c-a875-0b33aedbcb28 req-5c6da4cb-c6ff-4447-8acb-337fcd631a15 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-vif-unplugged-4dc0a45b-3038-4833-87a3-0293e49b4522 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:25:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Instance destroyed successfully.
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lazy-loading 'resources' on Instance uuid eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2116260090',display_name='tempest-ServerActionsTestOtherA-server-2116260090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2116260090',id=20,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7eifkDtVtPdxkpZe/4I9/HiUue30Vf5doS9SqUjKH5jebHwN2jx0sRu43j4YCMNKfGVma7XLfn6s2OvBwjKXrZ1ZSxRnENKN/oLTQis0bXoY4ezqnIljeHRQ0Qg2zvBg==',key_name='tempest-keypair-1004879733',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a553916b16f8404ca042ad82b503e6c7',ramdisk_id='',reservation_id='r-ipmrv07r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-886850923',owner_user_name='tempest-ServerActionsTestOtherA-886850923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='14df3bfebe7c43dca0a4ef2ee90f995b',uuid=eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converting VIF {"id": "4dc0a45b-3038-4833-87a3-0293e49b4522", "address": "fa:16:3e:6a:60:90", "network": {"id": "87516a18-e123-4a0c-b786-e5784816118b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1837545107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a553916b16f8404ca042ad82b503e6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dc0a45b-30", "ovs_interfaceid": "4dc0a45b-3038-4833-87a3-0293e49b4522", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:60:90,bridge_name='br-int',has_traffic_filtering=True,id=4dc0a45b-3038-4833-87a3-0293e49b4522,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc0a45b-30') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG os_vif [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:60:90,bridge_name='br-int',has_traffic_filtering=True,id=4dc0a45b-3038-4833-87a3-0293e49b4522,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc0a45b-30') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dc0a45b-30, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:25:52 user nova-compute[72904]: INFO os_vif [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:60:90,bridge_name='br-int',has_traffic_filtering=True,id=4dc0a45b-3038-4833-87a3-0293e49b4522,network=Network(87516a18-e123-4a0c-b786-e5784816118b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dc0a45b-30')
Aug 27 05:25:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Deleting instance files /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f_del
Aug 27 05:25:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Deletion of /opt/stack/data/nova/instances/eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f_del complete
Aug 27 05:25:52 user nova-compute[72904]: INFO nova.compute.manager [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 27 05:25:52 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:25:52 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:25:53 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:25:53 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Took 0.50 seconds to deallocate network for instance.
Aug 27 05:25:53 user nova-compute[72904]: DEBUG nova.compute.manager [req-5b750fef-6437-4e38-8948-97ad2590900c req-21ab5742-1dc1-4409-b086-367e8849b057 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-vif-deleted-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:53 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:25:53 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:25:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:53 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Deleted allocations for instance eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f
Aug 27 05:25:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0b4103da-6ced-4f7d-b312-5fcfade26271 tempest-ServerActionsTestOtherA-886850923 tempest-ServerActionsTestOtherA-886850923-project-member] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.701s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-c820eb50-1e1c-49ec-9ccd-b9567822d5e4 req-0ff46837-7a32-432f-a36a-7e9e04613227 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received event network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:25:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c820eb50-1e1c-49ec-9ccd-b9567822d5e4 req-0ff46837-7a32-432f-a36a-7e9e04613227 service nova] Acquiring lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:25:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c820eb50-1e1c-49ec-9ccd-b9567822d5e4 req-0ff46837-7a32-432f-a36a-7e9e04613227 service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:25:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c820eb50-1e1c-49ec-9ccd-b9567822d5e4 req-0ff46837-7a32-432f-a36a-7e9e04613227 service nova] Lock "eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:25:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-c820eb50-1e1c-49ec-9ccd-b9567822d5e4 req-0ff46837-7a32-432f-a36a-7e9e04613227 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] No waiting events found dispatching network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:25:54 user nova-compute[72904]: WARNING nova.compute.manager [req-c820eb50-1e1c-49ec-9ccd-b9567822d5e4 req-0ff46837-7a32-432f-a36a-7e9e04613227 service nova] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Received unexpected event network-vif-plugged-4dc0a45b-3038-4833-87a3-0293e49b4522 for instance with vm_state deleted and task_state None.
Aug 27 05:25:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:26:02 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113947.8275988, c2d438f2-0630-4fab-9eab-f00276a01949 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:26:02 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] VM Stopped (Lifecycle Event)
Aug 27 05:26:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cf1379b8-6c27-47a7-823f-574e09f9853b None None] [instance: c2d438f2-0630-4fab-9eab-f00276a01949] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:26:04 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113949.6183934, f88b1d96-56b7-4595-af27-50993d25d527 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:26:04 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f88b1d96-56b7-4595-af27-50993d25d527] VM Stopped (Lifecycle Event)
Aug 27 05:26:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a84e8798-e3f2-462b-b354-941c4346d05d None None] [instance: f88b1d96-56b7-4595-af27-50993d25d527] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:26:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:07 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693113952.7660127, eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:26:07 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] VM Stopped (Lifecycle Event)
Aug 27 05:26:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-21e9777f-9ded-46b2-b3cf-90d0e1147b9b None None] [instance: eab6c09a-f3b5-4706-b8bb-d5f09b4cee8f] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:26:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:26:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:26:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:26:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:26:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:26:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:26:18 user nova-compute[72904]: INFO nova.compute.claims [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Claim successful on node user
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:26:19 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.policy [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008a26244e704805b8f77410645a4e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63127190a4ad4846892961f9785fb132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:26:19 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Creating image(s)
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk 1073741824" returned: 0 in 0.051s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Successfully created port: f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Cannot resize image /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Ensure instance console log exists: /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Successfully updated port: f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquired lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.compute.manager [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-changed-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.compute.manager [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Refreshing instance network info cache due to event network-changed-f944dce2-6850-477e-a789-7561f8a90c01. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] Acquiring lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:26:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.neutron [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating instance_info_cache with network_info: [{"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Releasing lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Instance network_info: |[{"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] Acquired lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.neutron [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Refreshing network info cache for port f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Start _get_guest_xml network_info=[{"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:26:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:26:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1382889880',display_name='tempest-AttachVolumeNegativeTest-server-1382889880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1382889880',id=39,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkQMZBU5tAJhz5Q7Mohk7c/mqQDWjPm1pP1Eimsjp4Nz65OVWHnlPYbA47pxXNIW76FpOqhrJqLJYnUW3F9RlMecNHOB6tQWknEtFcntDjkB408TediwEcdwx5NcCZz5Q==',key_name='tempest-keypair-661803103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-3ukawj1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=bc93c9f1-59c7-4c48-9677-c74173f3c122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6f:e8,bridge_name='br-int',has_traffic_filtering=True,id=f944dce2-6850-477e-a789-7561f8a90c01,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf944dce2-68') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.objects.instance [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'pci_devices' on Instance uuid bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:26:21 user nova-compute[72904]:   <uuid>bc93c9f1-59c7-4c48-9677-c74173f3c122</uuid>
Aug 27 05:26:21 user nova-compute[72904]:   <name>instance-00000027</name>
Aug 27 05:26:21 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:26:21 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:26:21 user nova-compute[72904]:   <metadata>
Aug 27 05:26:21 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:26:21 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:26:21 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1382889880</nova:name>
Aug 27 05:26:21 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:26:21</nova:creationTime>
Aug 27 05:26:21 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:26:21 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:26:21 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:26:21 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:26:21 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:26:21 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:26:21 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:26:21 user nova-compute[72904]:       <nova:owner>
Aug 27 05:26:21 user nova-compute[72904]:         <nova:user uuid="008a26244e704805b8f77410645a4e7f">tempest-AttachVolumeNegativeTest-159688162-project-member</nova:user>
Aug 27 05:26:21 user nova-compute[72904]:         <nova:project uuid="63127190a4ad4846892961f9785fb132">tempest-AttachVolumeNegativeTest-159688162</nova:project>
Aug 27 05:26:21 user nova-compute[72904]:       </nova:owner>
Aug 27 05:26:21 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:26:21 user nova-compute[72904]:       <nova:ports>
Aug 27 05:26:21 user nova-compute[72904]:         <nova:port uuid="f944dce2-6850-477e-a789-7561f8a90c01">
Aug 27 05:26:21 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 27 05:26:21 user nova-compute[72904]:         </nova:port>
Aug 27 05:26:21 user nova-compute[72904]:       </nova:ports>
Aug 27 05:26:21 user nova-compute[72904]:     </nova:instance>
Aug 27 05:26:21 user nova-compute[72904]:   </metadata>
Aug 27 05:26:21 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:26:21 user nova-compute[72904]:     <system>
Aug 27 05:26:21 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:26:21 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:26:21 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:26:21 user nova-compute[72904]:       <entry name="serial">bc93c9f1-59c7-4c48-9677-c74173f3c122</entry>
Aug 27 05:26:21 user nova-compute[72904]:       <entry name="uuid">bc93c9f1-59c7-4c48-9677-c74173f3c122</entry>
Aug 27 05:26:21 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:26:21 user nova-compute[72904]:     </system>
Aug 27 05:26:21 user nova-compute[72904]:   </sysinfo>
Aug 27 05:26:21 user nova-compute[72904]:   <os>
Aug 27 05:26:21 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:26:21 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:26:21 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:26:21 user nova-compute[72904]:   </os>
Aug 27 05:26:21 user nova-compute[72904]:   <features>
Aug 27 05:26:21 user nova-compute[72904]:     <acpi/>
Aug 27 05:26:21 user nova-compute[72904]:     <apic/>
Aug 27 05:26:21 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:26:21 user nova-compute[72904]:   </features>
Aug 27 05:26:21 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:26:21 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:26:21 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:26:21 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:26:21 user nova-compute[72904]:   </clock>
Aug 27 05:26:21 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:26:21 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:26:21 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:26:21 user nova-compute[72904]:   </cpu>
Aug 27 05:26:21 user nova-compute[72904]:   <devices>
Aug 27 05:26:21 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:26:21 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:26:21 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk"/>
Aug 27 05:26:21 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:26:21 user nova-compute[72904]:     </disk>
Aug 27 05:26:21 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:26:21 user nova-compute[72904]:       <mac address="fa:16:3e:4a:6f:e8"/>
Aug 27 05:26:21 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:26:21 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:26:21 user nova-compute[72904]:       <target dev="tapf944dce2-68"/>
Aug 27 05:26:21 user nova-compute[72904]:     </interface>
Aug 27 05:26:21 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:26:21 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/console.log" append="off"/>
Aug 27 05:26:21 user nova-compute[72904]:     </serial>
Aug 27 05:26:21 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:26:21 user nova-compute[72904]:     <video>
Aug 27 05:26:21 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:26:21 user nova-compute[72904]:     </video>
Aug 27 05:26:21 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:26:21 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:26:21 user nova-compute[72904]:     </rng>
Aug 27 05:26:21 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:26:21 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:26:21 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:26:21 user nova-compute[72904]:     </memballoon>
Aug 27 05:26:21 user nova-compute[72904]:   </devices>
Aug 27 05:26:21 user nova-compute[72904]: </domain>
Aug 27 05:26:21 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1382889880',display_name='tempest-AttachVolumeNegativeTest-server-1382889880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1382889880',id=39,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkQMZBU5tAJhz5Q7Mohk7c/mqQDWjPm1pP1Eimsjp4Nz65OVWHnlPYbA47pxXNIW76FpOqhrJqLJYnUW3F9RlMecNHOB6tQWknEtFcntDjkB408TediwEcdwx5NcCZz5Q==',key_name='tempest-keypair-661803103',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-3ukawj1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=bc93c9f1-59c7-4c48-9677-c74173f3c122,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6f:e8,bridge_name='br-int',has_traffic_filtering=True,id=f944dce2-6850-477e-a789-7561f8a90c01,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf944dce2-68') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG os_vif [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6f:e8,bridge_name='br-int',has_traffic_filtering=True,id=f944dce2-6850-477e-a789-7561f8a90c01,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf944dce2-68') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf944dce2-68, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf944dce2-68, col_values=(('external_ids', {'iface-id': 'f944dce2-6850-477e-a789-7561f8a90c01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:6f:e8', 'vm-uuid': 'bc93c9f1-59c7-4c48-9677-c74173f3c122'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:21 user nova-compute[72904]: INFO os_vif [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:6f:e8,bridge_name='br-int',has_traffic_filtering=True,id=f944dce2-6850-477e-a789-7561f8a90c01,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf944dce2-68')
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No VIF found with MAC fa:16:3e:4a:6f:e8, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.neutron [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updated VIF entry in instance network info cache for port f944dce2-6850-477e-a789-7561f8a90c01. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG nova.network.neutron [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating instance_info_cache with network_info: [{"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:26:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-778410f8-2ad8-4407-9be2-f3b8d998f9fa req-50ba6f74-cd27-4639-b47d-777d9063ae14 service nova] Releasing lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-changed-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Refreshing instance network info cache due to event network-changed-b1ff6156-a160-4501-bc49-719d95d1c280. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] Acquiring lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] Acquired lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Refreshing network info cache for port b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updated VIF entry in instance network info cache for port b1ff6156-a160-4501-bc49-719d95d1c280. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updating instance_info_cache with network_info: [{"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-003bad10-20c5-4fc6-99a8-133fc06d509f req-9fefe274-ddf1-40fb-995d-6c4be37e9f32 service nova] Releasing lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] No waiting events found dispatching network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:26:24 user nova-compute[72904]: WARNING nova.compute.manager [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received unexpected event network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 for instance with vm_state building and task_state spawning.
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] No waiting events found dispatching network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:26:24 user nova-compute[72904]: WARNING nova.compute.manager [req-0d91b32b-0a10-4905-bb37-db968eb6c2b1 req-e8e5477f-821f-4500-8495-be27498e8d47 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received unexpected event network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 for instance with vm_state building and task_state spawning.
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113984.6418943, bc93c9f1-59c7-4c48-9677-c74173f3c122 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:26:24 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] VM Resumed (Lifecycle Event)
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:26:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Instance spawned successfully.
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:26:24 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693113984.642005, bc93c9f1-59c7-4c48-9677-c74173f3c122 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:26:24 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] VM Started (Lifecycle Event)
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:26:24 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:26:24 user nova-compute[72904]: INFO nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 27 05:26:24 user nova-compute[72904]: DEBUG nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:26:24 user nova-compute[72904]: INFO nova.compute.manager [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Took 5.95 seconds to build instance.
Aug 27 05:26:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-bc06bd98-54c2-41e6-9342-60d23005a42f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.049s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lazy-loading 'flavor' on Instance uuid bd0ea36f-1c42-426f-8d8f-4407b655f523 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Attaching volume a4de3cbf-d911-4bc6-ad50-cde8929fc88a to /dev/vdb
Aug 27 05:26:27 user nova-compute[72904]: DEBUG os_brick.utils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8452300f-4f8f-48c3-b5f6-a2f33d0f76c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52ce765-d8ba-4fa0-ba15-32baca43e15c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[923e94eb-4b85-4c42-86af-bae1e5b5fc21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdee5b36-5192-4a81-abd7-fd274717177f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:26:27 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:26:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6934448-4f70-45c8-a7f8-1907a896f219]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG os_brick.utils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:26:27 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updating existing volume attachment record: 8df7e17d-d511-4bfa-95b4-665f7bdd77dc {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:26:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIBJvdTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:26:38 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:26:38 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:26:38 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d92ca1-c47b-49e3-9710-266f316e9b2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:26:38 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d1bac1-75ce-4957-9173-18e9a75d462d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a] added
Aug 27 05:26:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f560f6-3191-4cf5-94ff-a6bdfd3946ea]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1da258-cd4e-4e0a-a2c4-fc3f25bf7dd9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIBJvdTU {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIBJvdTU" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f65e9-c1f8-4953-9903-21d7cb327251]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XIBJvdTU'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae838a85-fb82-4d3f-a397-82ec3de1a3b7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1553f397-6133-4d60-84ac-d716a9e02850]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:26:38 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:26:38 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:26:38 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:26:38 user nova-compute[72904]: 
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d81d0b-bc74-427c-86ca-69de740636c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260]
Aug 27 05:26:38 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260] successful.
Aug 27 05:26:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a282df-7be5-4576-8d6e-5af39116ba62]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51bb253-d307-407f-a424-a9347d6d40c2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a (non-flash)
Aug 27 05:26:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a (non-flash)
Aug 27 05:26:38 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c92e2d6-3e24-46b5-9f4a-ce9a9b924393]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:38 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIBJvdTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23036343330383938', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036343330383938', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lazy-loading 'flavor' on Instance uuid bd0ea36f-1c42-426f-8d8f-4407b655f523 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:26:39 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:26:39 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:26:39 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:26:39 user nova-compute[72904]:   <serial>a4de3cbf-d911-4bc6-ad50-cde8929fc88a</serial>
Aug 27 05:26:39 user nova-compute[72904]: </disk>
Aug 27 05:26:39 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:26:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:26:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8353MB free_disk=25.391170501708984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] No VIF found with MAC fa:16:3e:24:91:1f, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bd0ea36f-1c42-426f-8d8f-4407b655f523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bc93c9f1-59c7-4c48-9677-c74173f3c122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6287997f-e378-4386-9e00-3fd80ac2b4b1 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.059s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:26:42 user nova-compute[72904]: INFO nova.compute.manager [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Detaching volume a4de3cbf-d911-4bc6-ad50-cde8929fc88a
Aug 27 05:26:42 user nova-compute[72904]: INFO nova.virt.block_device [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Attempting to driver detach volume a4de3cbf-d911-4bc6-ad50-cde8929fc88a from mountpoint /dev/vdb
Aug 27 05:26:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Attempting to detach device vdb from instance bd0ea36f-1c42-426f-8d8f-4407b655f523 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:26:42 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:26:42 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:26:42 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:26:42 user nova-compute[72904]:   <serial>a4de3cbf-d911-4bc6-ad50-cde8929fc88a</serial>
Aug 27 05:26:42 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:26:42 user nova-compute[72904]: </disk>
Aug 27 05:26:42 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:26:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Successfully detached device vdb from instance bd0ea36f-1c42-426f-8d8f-4407b655f523 from the persistent domain config.
Aug 27 05:26:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bd0ea36f-1c42-426f-8d8f-4407b655f523 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:26:42 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:26:42 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:26:42 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:26:42 user nova-compute[72904]:   <serial>a4de3cbf-d911-4bc6-ad50-cde8929fc88a</serial>
Aug 27 05:26:42 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:26:42 user nova-compute[72904]: </disk>
Aug 27 05:26:42 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693114002.71063, bd0ea36f-1c42-426f-8d8f-4407b655f523 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bd0ea36f-1c42-426f-8d8f-4407b655f523 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:26:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Successfully detached device vdb from instance bd0ea36f-1c42-426f-8d8f-4407b655f523 from the live domain config.
Aug 27 05:26:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIBJvdTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:26:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b779c0e-6372-4cea-b220-cfb70ddb30e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0201dd84-38f1-416d-90d6-c8db11f448e2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a (non-flash)
Aug 27 05:26:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a (non-flash)
Aug 27 05:26:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c5e23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ec4d8-d5f1-4d22-8bec-a35fa5000440]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d965c087-506d-402b-8608-df3bd7dd48c5]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca9382-72e9-4c90-bc32-651d2d74c17a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[65990915-f8d1-4956-8209-a84597d4ac75]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4414600b-24b9-4d5a-a481-93890bdb2d6c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61e73e6-53c5-4505-9e34-3da9de6666d3]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260]
Aug 27 05:26:42 user nova-compute[72904]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a, portal: 172.16.0.220,3260] successful.
Aug 27 05:26:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4de3cbf-d911-4bc6-ad50-cde8929fc88a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce615cf-b82d-4947-92de-d372e3530fbc]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] <== disconnect_volume: return (278ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lazy-loading 'flavor' on Instance uuid bd0ea36f-1c42-426f-8d8f-4407b655f523 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:26:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e6e6c036-69cd-4533-91d2-d120a9bca4e6 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:26:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:45 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:26:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:46 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:47 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:26:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:26:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:26:49 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:26:50 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updating instance_info_cache with network_info: [{"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:26:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-bd0ea36f-1c42-426f-8d8f-4407b655f523" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:26:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:26:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:51 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:51 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:26:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:26:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:27:10 user nova-compute[72904]: INFO nova.compute.claims [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Claim successful on node user
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:27:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:27:10 user nova-compute[72904]: INFO nova.virt.block_device [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Booting with volume 53a8e5f7-7bf8-4d55-9aea-5106b4130a3e at /dev/vda
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.policy [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c0f942b9b2c4fb58c83f0f5b8edc69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad2ad0b23fa4d94a54465cf73502f0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG os_brick.utils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f94c8-9199-4b29-8c42-a98ff638a5ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe30236-7b8a-4d87-9d45-3996b6fd9546]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4bfda3-1aa3-449d-b3fb-8116852b6054]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7031e07e-ee9c-4049-a37f-4e2a33686dc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:27:10 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:27:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[683ad372-70ce-4b1f-bf7c-c7f8d2552a90]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG os_brick.utils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:27:10 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating existing volume attachment record: df5009e6-cd21-4b6d-8788-4e446a12d414 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:27:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Successfully created port: 007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:27:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Successfully updated port: 007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:27:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:27:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquired lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:27:11 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-changed-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Refreshing instance network info cache due to event network-changed-007384cf-88fd-4e73-9c0d-5d8d217060cd. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] Acquiring lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating instance_info_cache with network_info: [{"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Releasing lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance network_info: |[{"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] Acquired lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.network.neutron [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Refreshing network info cache for port 007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.network.neutron [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updated VIF entry in instance network info cache for port 007384cf-88fd-4e73-9c0d-5d8d217060cd. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG nova.network.neutron [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating instance_info_cache with network_info: [{"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:27:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-30705d7f-df28-4085-91af-7c6f67b4bc7b req-6d80107d-2ab3-4234-8256-f007ab76df66 service nova] Releasing lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:27:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:27:21 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Creating image(s)
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Ensure instance console log exists: /opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Start _get_guest_xml network_info=[{"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'df5009e6-cd21-4b6d-8788-4e446a12d414', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d885076-587e-42ff-b0e4-295860b5bc75', 'attached_at': '', 'detached_at': '', 'volume_id': '53a8e5f7-7bf8-4d55-9aea-5106b4130a3e', 'serial': '53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:27:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:27:21 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:27:21 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:27:21 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:27:21 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241f336-38bc-4d4f-aaf1-5638293ded98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:27:21 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e79098-c30f-421f-8c56-0182a7b45667]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e] added
Aug 27 05:27:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad3279d-91ed-4b7e-8a1d-6325679843c9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ba1790-b156-4445-9d89-2bd2d90cd9dc]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFpEOZQN {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFpEOZQN" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c759de3e-3f0d-4c7a-8bdc-fdcf3b5361ee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFpEOZQN'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae08be-4d5c-4b62-9462-d5e382b74054]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[540bcb85-920e-420b-ad7b-da94606035ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:27:22 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:27:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:27:22 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:27:22 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:27:22 user nova-compute[72904]: 
Aug 27 05:27:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --login" returned: 0 in 1.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aa5177-9f99-47da-94ad-a0c83bc88644]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]
Aug 27 05:27:23 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.
Aug 27 05:27:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bc5686-5621-47db-9841-53f7cfd54486]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[31178f57-7f30-403c-977d-25921ddf2ae4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:27:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:27:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.268s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5cafe8-99a8-455f-9a58-0082b20ad754]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "0a4e81cc-431f-422f-9222-77f052490a01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "0a4e81cc-431f-422f-9222-77f052490a01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:27:23 user nova-compute[72904]: INFO nova.compute.claims [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Claim successful on node user
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:27:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:27:23 user nova-compute[72904]: INFO nova.virt.block_device [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Booting with volume snapshot bd772144-ad33-4eba-995a-decfa62c0d7e at /dev/vda
Aug 27 05:27:23 user nova-compute[72904]: DEBUG nova.policy [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fd6f1e0a2843cca915e52045b78d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41729cc06fa94b569a46e971b769d96f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.303s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] <== connect_volume: return (2304ms) {'type': 'block', 'scsi_wwn': '23832323939326434', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832323939326434', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-363355423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-363355423',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB41jIEta1Wjr2W1L1neBnORvuhB9kUCKDt9im7ZtangeVumN2WkX6YS0ZpXTz198bq+o7nF+6Zi+WqUKUkU2zWvq2qzOcw+O5CJIsb7yGjixKzc9Qee4rwCkUirc9/o9A==',key_name='tempest-keypair-1288777666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aad2ad0b23fa4d94a54465cf73502f0e',ramdisk_id='',reservation_id='r-1opq4zxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-168812509',owner_user_name='tempest-ServerActionsV293TestJSON-168812509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c0f942b9b2c4fb58c83f0f5b8edc69e',uuid=0d885076-587e-42ff-b0e4-295860b5bc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converting VIF {"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.objects.instance [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d885076-587e-42ff-b0e4-295860b5bc75 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:27:24 user nova-compute[72904]:   <uuid>0d885076-587e-42ff-b0e4-295860b5bc75</uuid>
Aug 27 05:27:24 user nova-compute[72904]:   <name>instance-00000028</name>
Aug 27 05:27:24 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:27:24 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:27:24 user nova-compute[72904]:   <metadata>
Aug 27 05:27:24 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:27:24 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:27:24 user nova-compute[72904]:       <nova:name>tempest-ServerActionsV293TestJSON-server-363355423</nova:name>
Aug 27 05:27:24 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:27:21</nova:creationTime>
Aug 27 05:27:24 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:27:24 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:27:24 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:27:24 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:27:24 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:27:24 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:27:24 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:27:24 user nova-compute[72904]:       <nova:owner>
Aug 27 05:27:24 user nova-compute[72904]:         <nova:user uuid="5c0f942b9b2c4fb58c83f0f5b8edc69e">tempest-ServerActionsV293TestJSON-168812509-project-member</nova:user>
Aug 27 05:27:24 user nova-compute[72904]:         <nova:project uuid="aad2ad0b23fa4d94a54465cf73502f0e">tempest-ServerActionsV293TestJSON-168812509</nova:project>
Aug 27 05:27:24 user nova-compute[72904]:       </nova:owner>
Aug 27 05:27:24 user nova-compute[72904]:       <nova:ports>
Aug 27 05:27:24 user nova-compute[72904]:         <nova:port uuid="007384cf-88fd-4e73-9c0d-5d8d217060cd">
Aug 27 05:27:24 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:27:24 user nova-compute[72904]:         </nova:port>
Aug 27 05:27:24 user nova-compute[72904]:       </nova:ports>
Aug 27 05:27:24 user nova-compute[72904]:     </nova:instance>
Aug 27 05:27:24 user nova-compute[72904]:   </metadata>
Aug 27 05:27:24 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:27:24 user nova-compute[72904]:     <system>
Aug 27 05:27:24 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:27:24 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:27:24 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:27:24 user nova-compute[72904]:       <entry name="serial">0d885076-587e-42ff-b0e4-295860b5bc75</entry>
Aug 27 05:27:24 user nova-compute[72904]:       <entry name="uuid">0d885076-587e-42ff-b0e4-295860b5bc75</entry>
Aug 27 05:27:24 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:27:24 user nova-compute[72904]:     </system>
Aug 27 05:27:24 user nova-compute[72904]:   </sysinfo>
Aug 27 05:27:24 user nova-compute[72904]:   <os>
Aug 27 05:27:24 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:27:24 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:27:24 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:27:24 user nova-compute[72904]:   </os>
Aug 27 05:27:24 user nova-compute[72904]:   <features>
Aug 27 05:27:24 user nova-compute[72904]:     <acpi/>
Aug 27 05:27:24 user nova-compute[72904]:     <apic/>
Aug 27 05:27:24 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:27:24 user nova-compute[72904]:   </features>
Aug 27 05:27:24 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:27:24 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:27:24 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:27:24 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:27:24 user nova-compute[72904]:   </clock>
Aug 27 05:27:24 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:27:24 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:27:24 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:27:24 user nova-compute[72904]:   </cpu>
Aug 27 05:27:24 user nova-compute[72904]:   <devices>
Aug 27 05:27:24 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:27:24 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:27:24 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:27:24 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:27:24 user nova-compute[72904]:       <serial>53a8e5f7-7bf8-4d55-9aea-5106b4130a3e</serial>
Aug 27 05:27:24 user nova-compute[72904]:     </disk>
Aug 27 05:27:24 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:27:24 user nova-compute[72904]:       <mac address="fa:16:3e:e0:a8:c8"/>
Aug 27 05:27:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:27:24 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:27:24 user nova-compute[72904]:       <target dev="tap007384cf-88"/>
Aug 27 05:27:24 user nova-compute[72904]:     </interface>
Aug 27 05:27:24 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:27:24 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75/console.log" append="off"/>
Aug 27 05:27:24 user nova-compute[72904]:     </serial>
Aug 27 05:27:24 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:27:24 user nova-compute[72904]:     <video>
Aug 27 05:27:24 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:27:24 user nova-compute[72904]:     </video>
Aug 27 05:27:24 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:27:24 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:27:24 user nova-compute[72904]:     </rng>
Aug 27 05:27:24 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:27:24 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:27:24 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:27:24 user nova-compute[72904]:     </memballoon>
Aug 27 05:27:24 user nova-compute[72904]:   </devices>
Aug 27 05:27:24 user nova-compute[72904]: </domain>
Aug 27 05:27:24 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-363355423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-363355423',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB41jIEta1Wjr2W1L1neBnORvuhB9kUCKDt9im7ZtangeVumN2WkX6YS0ZpXTz198bq+o7nF+6Zi+WqUKUkU2zWvq2qzOcw+O5CJIsb7yGjixKzc9Qee4rwCkUirc9/o9A==',key_name='tempest-keypair-1288777666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aad2ad0b23fa4d94a54465cf73502f0e',ramdisk_id='',reservation_id='r-1opq4zxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-168812509',owner_user_name='tempest-ServerActionsV293TestJSON-168812509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:27:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c0f942b9b2c4fb58c83f0f5b8edc69e',uuid=0d885076-587e-42ff-b0e4-295860b5bc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converting VIF {"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG os_vif [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007384cf-88, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap007384cf-88, col_values=(('external_ids', {'iface-id': '007384cf-88fd-4e73-9c0d-5d8d217060cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a8:c8', 'vm-uuid': '0d885076-587e-42ff-b0e4-295860b5bc75'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:24 user nova-compute[72904]: INFO os_vif [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88')
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] No VIF found with MAC fa:16:3e:e0:a8:c8, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:27:24 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Successfully created port: 8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Successfully updated port: 8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "refresh_cache-0a4e81cc-431f-422f-9222-77f052490a01" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquired lock "refresh_cache-0a4e81cc-431f-422f-9222-77f052490a01" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received event network-changed-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Refreshing instance network info cache due to event network-changed-8bcad154-dda9-45dd-9e9f-40dc5e976c01. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] Acquiring lock "refresh_cache-0a4e81cc-431f-422f-9222-77f052490a01" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Updating instance_info_cache with network_info: [{"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Releasing lock "refresh_cache-0a4e81cc-431f-422f-9222-77f052490a01" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Instance network_info: |[{"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] Acquired lock "refresh_cache-0a4e81cc-431f-422f-9222-77f052490a01" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Refreshing network info cache for port 8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-25ff9d98-d501-4d5e-bd47-8128fa843007 req-316b7e61-0e85-4561-a29d-0f5e28195eaf service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25ff9d98-d501-4d5e-bd47-8128fa843007 req-316b7e61-0e85-4561-a29d-0f5e28195eaf service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25ff9d98-d501-4d5e-bd47-8128fa843007 req-316b7e61-0e85-4561-a29d-0f5e28195eaf service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25ff9d98-d501-4d5e-bd47-8128fa843007 req-316b7e61-0e85-4561-a29d-0f5e28195eaf service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-25ff9d98-d501-4d5e-bd47-8128fa843007 req-316b7e61-0e85-4561-a29d-0f5e28195eaf service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No waiting events found dispatching network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:25 user nova-compute[72904]: WARNING nova.compute.manager [req-25ff9d98-d501-4d5e-bd47-8128fa843007 req-316b7e61-0e85-4561-a29d-0f5e28195eaf service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received unexpected event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with vm_state building and task_state spawning.
Aug 27 05:27:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Updated VIF entry in instance network info cache for port 8bcad154-dda9-45dd-9e9f-40dc5e976c01. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:27:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Updating instance_info_cache with network_info: [{"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:27:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-0a14860b-3d47-42e4-868e-3693e21de6a0 req-a1147907-5560-46b1-a4e4-756972624a25 service nova] Releasing lock "refresh_cache-0a4e81cc-431f-422f-9222-77f052490a01" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:27:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114047.8306215, 0d885076-587e-42ff-b0e4-295860b5bc75 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:27:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] VM Resumed (Lifecycle Event)
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:27:27 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance spawned successfully.
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114047.8318017, 0d885076-587e-42ff-b0e4-295860b5bc75 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:27:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] VM Started (Lifecycle Event)
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:27:27 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:27:27 user nova-compute[72904]: INFO nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-f2420889-a85b-4345-a54a-0df22ede5af9 req-47108b83-4d69-440e-b06e-7782810b585d service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f2420889-a85b-4345-a54a-0df22ede5af9 req-47108b83-4d69-440e-b06e-7782810b585d service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f2420889-a85b-4345-a54a-0df22ede5af9 req-47108b83-4d69-440e-b06e-7782810b585d service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f2420889-a85b-4345-a54a-0df22ede5af9 req-47108b83-4d69-440e-b06e-7782810b585d service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-f2420889-a85b-4345-a54a-0df22ede5af9 req-47108b83-4d69-440e-b06e-7782810b585d service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No waiting events found dispatching network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:27 user nova-compute[72904]: WARNING nova.compute.manager [req-f2420889-a85b-4345-a54a-0df22ede5af9 req-47108b83-4d69-440e-b06e-7782810b585d service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received unexpected event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with vm_state building and task_state spawning.
Aug 27 05:27:28 user nova-compute[72904]: INFO nova.compute.manager [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Took 17.89 seconds to build instance.
Aug 27 05:27:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eed4f181-59a7-460e-afd9-41f6d774de1e tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.016s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG os_brick.utils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[557aa632-90e1-4a2b-ae7e-81857377dddd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b9eadf-ee8f-44a0-842d-c98bf6f0bd3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad171c7c-3cec-4b19-a586-a3990df02e2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcef982c-2e7e-466c-b462-a759b44e040f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:27:29 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:27:29 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c009a1bd-bf58-4581-a374-0096c033ef79]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG os_brick.utils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:27:29 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Updating existing volume attachment record: ed4faa32-70f4-4c52-be3e-ee63947a6ef7 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:27:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:40 user nova-compute[72904]: INFO nova.compute.manager [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Terminating instance
Aug 27 05:27:40 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG nova.compute.manager [req-37dfd8a4-9d50-47d8-8ce6-e3eebe23b469 req-a66d5f71-413a-4ddb-a513-6027012955b6 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-unplugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-37dfd8a4-9d50-47d8-8ce6-e3eebe23b469 req-a66d5f71-413a-4ddb-a513-6027012955b6 service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-37dfd8a4-9d50-47d8-8ce6-e3eebe23b469 req-a66d5f71-413a-4ddb-a513-6027012955b6 service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-37dfd8a4-9d50-47d8-8ce6-e3eebe23b469 req-a66d5f71-413a-4ddb-a513-6027012955b6 service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG nova.compute.manager [req-37dfd8a4-9d50-47d8-8ce6-e3eebe23b469 req-a66d5f71-413a-4ddb-a513-6027012955b6 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-unplugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG nova.compute.manager [req-37dfd8a4-9d50-47d8-8ce6-e3eebe23b469 req-a66d5f71-413a-4ddb-a513-6027012955b6 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-unplugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Instance destroyed successfully.
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.objects.instance [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lazy-loading 'resources' on Instance uuid bd0ea36f-1c42-426f-8d8f-4407b655f523 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:27:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:27:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8357MB free_disk=25.376060485839844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:24:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-754453068',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-754453068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7544530',id=38,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDr+8WpN2NOfB8zkdK+hPpKH62R8foUa4fYk2RJ5rg4kUd+sEMY3x8eh4DaVFRI4qGeBzkHw4bx+qZEgSxKwETqXJrSg3fFznuPQgwrzvYJwaqZqdIoacxwZv8iPA36cQ==',key_name='tempest-keypair-1291554012',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:24:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e827a16ef56e4530b4ac80472befef1a',ramdisk_id='',reservation_id='r-m8gl7pac',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1414241050',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:24:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad789d010e2f46d9b327fc2db624c241',uuid=bd0ea36f-1c42-426f-8d8f-4407b655f523,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Converting VIF {"id": "b1ff6156-a160-4501-bc49-719d95d1c280", "address": "fa:16:3e:24:91:1f", "network": {"id": "f4ebee8a-7a14-4b76-b963-1c480841f2e4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-904877951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e827a16ef56e4530b4ac80472befef1a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ff6156-a1", "ovs_interfaceid": "b1ff6156-a160-4501-bc49-719d95d1c280", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=b1ff6156-a160-4501-bc49-719d95d1c280,network=Network(f4ebee8a-7a14-4b76-b963-1c480841f2e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ff6156-a1') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG os_vif [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=b1ff6156-a160-4501-bc49-719d95d1c280,network=Network(f4ebee8a-7a14-4b76-b963-1c480841f2e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ff6156-a1') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1ff6156-a1, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:27:41 user nova-compute[72904]: INFO os_vif [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:91:1f,bridge_name='br-int',has_traffic_filtering=True,id=b1ff6156-a160-4501-bc49-719d95d1c280,network=Network(f4ebee8a-7a14-4b76-b963-1c480841f2e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ff6156-a1')
Aug 27 05:27:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Deleting instance files /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523_del
Aug 27 05:27:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Deletion of /opt/stack/data/nova/instances/bd0ea36f-1c42-426f-8d8f-4407b655f523_del complete
Aug 27 05:27:41 user nova-compute[72904]: INFO nova.compute.manager [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 27 05:27:41 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bd0ea36f-1c42-426f-8d8f-4407b655f523 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bc93c9f1-59c7-4c48-9677-c74173f3c122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0d885076-587e-42ff-b0e4-295860b5bc75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0a4e81cc-431f-422f-9222-77f052490a01 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:27:42 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Took 0.91 seconds to deallocate network for instance.
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-fca70e3e-7dc3-4687-abcb-851a1b9738bd req-81b14cf8-9453-44bb-8d33-4c3efbf93fd7 service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-deleted-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:42 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Deleted allocations for instance bd0ea36f-1c42-426f-8d8f-4407b655f523
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:42 user nova-compute[72904]: WARNING nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received unexpected event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with vm_state deleted and task_state None.
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:42 user nova-compute[72904]: WARNING nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received unexpected event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with vm_state deleted and task_state None.
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:42 user nova-compute[72904]: WARNING nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received unexpected event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with vm_state deleted and task_state None.
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-unplugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-unplugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:42 user nova-compute[72904]: WARNING nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received unexpected event network-vif-unplugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with vm_state deleted and task_state None.
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Acquiring lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:42 user nova-compute[72904]: DEBUG nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] No waiting events found dispatching network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:42 user nova-compute[72904]: WARNING nova.compute.manager [req-c4187fef-1f4d-4e08-91d2-6afce8800d5e req-f5abfc25-e332-4b21-82ad-3e1fff2e816d service nova] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Received unexpected event network-vif-plugged-b1ff6156-a160-4501-bc49-719d95d1c280 for instance with vm_state deleted and task_state None.
Aug 27 05:27:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-fbcfdf28-410b-4b57-9b24-3d43dc5ccc54 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050 tempest-TestServerVolumeAttachScenarioOldVersion-1414241050-project-member] Lock "bd0ea36f-1c42-426f-8d8f-4407b655f523" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:27:43 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Creating image(s)
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Ensure instance console log exists: /opt/stack/data/nova/instances/0a4e81cc-431f-422f-9222-77f052490a01/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Start _get_guest_xml network_info=[{"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ed4faa32-70f4-4c52-be3e-ee63947a6ef7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTsajDSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0a4e81cc-431f-422f-9222-77f052490a01', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7994d34-8224-428b-b34e-cc825a78bfb8', 'serial': 'f7994d34-8224-428b-b34e-cc825a78bfb8'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:27:43 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:27:43 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTsajDSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:27:43 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:27:43 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:27:43 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[205ad16a-307a-4b30-bff8-4468d54fdb5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:27:43 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f89e46-d7de-4e22-a99c-f8776a98908e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8] added
Aug 27 05:27:43 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a3631-22a7-405a-8d9d-ddd2f909820f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0271b1-4077-42ae-9364-7dd952259ee9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTsajDSm {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gTsajDSm" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b37905-d85c-47cd-87cb-6915e9dc7652]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gTsajDSm'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[217a47b7-9774-4c73-bff2-c2f377e283e5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eda0a04-989d-4b22-8efc-daca2559ba50]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:27:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:27:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a525fffa-7d93-4839-8e52-e7c0c2fd6acb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260]
Aug 27 05:27:44 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260] successful.
Aug 27 05:27:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a276b1a-ffe3-430b-b4ba-8e73e6de4124]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d458638-65ad-4b8b-8151-91bd929e8c5d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:27:44 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:27:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:27:44 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:27:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c6f5f4-7d9b-40f3-acfe-5b61b6e9566d]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTsajDSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23265623933653336', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265623933653336', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-856689202',display_name='tempest-TestVolumeBootPattern-server-856689202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-856689202',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-vcpb0e2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:27:24Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=0a4e81cc-431f-422f-9222-77f052490a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:1c:81,bridge_name='br-int',has_traffic_filtering=True,id=8bcad154-dda9-45dd-9e9f-40dc5e976c01,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcad154-dd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a4e81cc-431f-422f-9222-77f052490a01 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:27:45 user nova-compute[72904]:   <uuid>0a4e81cc-431f-422f-9222-77f052490a01</uuid>
Aug 27 05:27:45 user nova-compute[72904]:   <name>instance-00000029</name>
Aug 27 05:27:45 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:27:45 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:27:45 user nova-compute[72904]:   <metadata>
Aug 27 05:27:45 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:27:45 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:27:45 user nova-compute[72904]:       <nova:name>tempest-TestVolumeBootPattern-server-856689202</nova:name>
Aug 27 05:27:45 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:27:43</nova:creationTime>
Aug 27 05:27:45 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:27:45 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:27:45 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:27:45 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:27:45 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:27:45 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:27:45 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:27:45 user nova-compute[72904]:       <nova:owner>
Aug 27 05:27:45 user nova-compute[72904]:         <nova:user uuid="75fd6f1e0a2843cca915e52045b78d4f">tempest-TestVolumeBootPattern-1154964358-project-member</nova:user>
Aug 27 05:27:45 user nova-compute[72904]:         <nova:project uuid="41729cc06fa94b569a46e971b769d96f">tempest-TestVolumeBootPattern-1154964358</nova:project>
Aug 27 05:27:45 user nova-compute[72904]:       </nova:owner>
Aug 27 05:27:45 user nova-compute[72904]:       <nova:ports>
Aug 27 05:27:45 user nova-compute[72904]:         <nova:port uuid="8bcad154-dda9-45dd-9e9f-40dc5e976c01">
Aug 27 05:27:45 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 27 05:27:45 user nova-compute[72904]:         </nova:port>
Aug 27 05:27:45 user nova-compute[72904]:       </nova:ports>
Aug 27 05:27:45 user nova-compute[72904]:     </nova:instance>
Aug 27 05:27:45 user nova-compute[72904]:   </metadata>
Aug 27 05:27:45 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:27:45 user nova-compute[72904]:     <system>
Aug 27 05:27:45 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:27:45 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:27:45 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:27:45 user nova-compute[72904]:       <entry name="serial">0a4e81cc-431f-422f-9222-77f052490a01</entry>
Aug 27 05:27:45 user nova-compute[72904]:       <entry name="uuid">0a4e81cc-431f-422f-9222-77f052490a01</entry>
Aug 27 05:27:45 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:27:45 user nova-compute[72904]:     </system>
Aug 27 05:27:45 user nova-compute[72904]:   </sysinfo>
Aug 27 05:27:45 user nova-compute[72904]:   <os>
Aug 27 05:27:45 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:27:45 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:27:45 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:27:45 user nova-compute[72904]:   </os>
Aug 27 05:27:45 user nova-compute[72904]:   <features>
Aug 27 05:27:45 user nova-compute[72904]:     <acpi/>
Aug 27 05:27:45 user nova-compute[72904]:     <apic/>
Aug 27 05:27:45 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:27:45 user nova-compute[72904]:   </features>
Aug 27 05:27:45 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:27:45 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:27:45 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:27:45 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:27:45 user nova-compute[72904]:   </clock>
Aug 27 05:27:45 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:27:45 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:27:45 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:27:45 user nova-compute[72904]:   </cpu>
Aug 27 05:27:45 user nova-compute[72904]:   <devices>
Aug 27 05:27:45 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:27:45 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:27:45 user nova-compute[72904]:       <source dev="/dev/sdc"/>
Aug 27 05:27:45 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:27:45 user nova-compute[72904]:       <serial>f7994d34-8224-428b-b34e-cc825a78bfb8</serial>
Aug 27 05:27:45 user nova-compute[72904]:     </disk>
Aug 27 05:27:45 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:27:45 user nova-compute[72904]:       <mac address="fa:16:3e:da:1c:81"/>
Aug 27 05:27:45 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:27:45 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:27:45 user nova-compute[72904]:       <target dev="tap8bcad154-dd"/>
Aug 27 05:27:45 user nova-compute[72904]:     </interface>
Aug 27 05:27:45 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:27:45 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/0a4e81cc-431f-422f-9222-77f052490a01/console.log" append="off"/>
Aug 27 05:27:45 user nova-compute[72904]:     </serial>
Aug 27 05:27:45 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:27:45 user nova-compute[72904]:     <video>
Aug 27 05:27:45 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:27:45 user nova-compute[72904]:     </video>
Aug 27 05:27:45 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:27:45 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:27:45 user nova-compute[72904]:     </rng>
Aug 27 05:27:45 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:27:45 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:27:45 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:27:45 user nova-compute[72904]:     </memballoon>
Aug 27 05:27:45 user nova-compute[72904]:   </devices>
Aug 27 05:27:45 user nova-compute[72904]: </domain>
Aug 27 05:27:45 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-856689202',display_name='tempest-TestVolumeBootPattern-server-856689202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-856689202',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-vcpb0e2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:27:24Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=0a4e81cc-431f-422f-9222-77f052490a01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:1c:81,bridge_name='br-int',has_traffic_filtering=True,id=8bcad154-dda9-45dd-9e9f-40dc5e976c01,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcad154-dd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG os_vif [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:1c:81,bridge_name='br-int',has_traffic_filtering=True,id=8bcad154-dda9-45dd-9e9f-40dc5e976c01,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcad154-dd') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bcad154-dd, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bcad154-dd, col_values=(('external_ids', {'iface-id': '8bcad154-dda9-45dd-9e9f-40dc5e976c01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:1c:81', 'vm-uuid': '0a4e81cc-431f-422f-9222-77f052490a01'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:45 user nova-compute[72904]: INFO os_vif [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:1c:81,bridge_name='br-int',has_traffic_filtering=True,id=8bcad154-dda9-45dd-9e9f-40dc5e976c01,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcad154-dd')
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:27:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No VIF found with MAC fa:16:3e:da:1c:81, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-2db8656e-edfa-4de8-916d-2cd4d38337ad req-a19f305c-6357-4f88-bcea-d125c6ccdd95 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received event network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2db8656e-edfa-4de8-916d-2cd4d38337ad req-a19f305c-6357-4f88-bcea-d125c6ccdd95 service nova] Acquiring lock "0a4e81cc-431f-422f-9222-77f052490a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2db8656e-edfa-4de8-916d-2cd4d38337ad req-a19f305c-6357-4f88-bcea-d125c6ccdd95 service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-2db8656e-edfa-4de8-916d-2cd4d38337ad req-a19f305c-6357-4f88-bcea-d125c6ccdd95 service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:46 user nova-compute[72904]: DEBUG nova.compute.manager [req-2db8656e-edfa-4de8-916d-2cd4d38337ad req-a19f305c-6357-4f88-bcea-d125c6ccdd95 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] No waiting events found dispatching network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:46 user nova-compute[72904]: WARNING nova.compute.manager [req-2db8656e-edfa-4de8-916d-2cd4d38337ad req-a19f305c-6357-4f88-bcea-d125c6ccdd95 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received unexpected event network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 for instance with vm_state building and task_state spawning.
Aug 27 05:27:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:47 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114068.656855, 0a4e81cc-431f-422f-9222-77f052490a01 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:27:48 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] VM Resumed (Lifecycle Event)
Aug 27 05:27:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:27:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Instance spawned successfully.
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:27:48 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114068.6592488, 0a4e81cc-431f-422f-9222-77f052490a01 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:27:48 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] VM Started (Lifecycle Event)
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:27:48 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:27:48 user nova-compute[72904]: INFO nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-607abe6d-3df5-4436-9180-94990db70bf5 req-40002702-9bac-495e-8202-52b74f850a4d service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received event network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-607abe6d-3df5-4436-9180-94990db70bf5 req-40002702-9bac-495e-8202-52b74f850a4d service nova] Acquiring lock "0a4e81cc-431f-422f-9222-77f052490a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-607abe6d-3df5-4436-9180-94990db70bf5 req-40002702-9bac-495e-8202-52b74f850a4d service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-607abe6d-3df5-4436-9180-94990db70bf5 req-40002702-9bac-495e-8202-52b74f850a4d service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-607abe6d-3df5-4436-9180-94990db70bf5 req-40002702-9bac-495e-8202-52b74f850a4d service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] No waiting events found dispatching network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:27:48 user nova-compute[72904]: WARNING nova.compute.manager [req-607abe6d-3df5-4436-9180-94990db70bf5 req-40002702-9bac-495e-8202-52b74f850a4d service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received unexpected event network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 for instance with vm_state building and task_state spawning.
Aug 27 05:27:48 user nova-compute[72904]: INFO nova.compute.manager [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Took 25.34 seconds to build instance.
Aug 27 05:27:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7726b1d-cdca-49e8-bb4b-c781d4535914 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "0a4e81cc-431f-422f-9222-77f052490a01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.431s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:27:50 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:27:51 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating instance_info_cache with network_info: [{"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:27:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:27:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:27:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:27:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:27:56 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114060.985998, bd0ea36f-1c42-426f-8d8f-4407b655f523 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:27:56 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] VM Stopped (Lifecycle Event)
Aug 27 05:27:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-4539539d-9564-4080-bbba-0cca01174c17 None None] [instance: bd0ea36f-1c42-426f-8d8f-4407b655f523] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:27:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-changed-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Refreshing instance network info cache due to event network-changed-f944dce2-6850-477e-a789-7561f8a90c01. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] Acquiring lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] Acquired lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Refreshing network info cache for port f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updated VIF entry in instance network info cache for port f944dce2-6850-477e-a789-7561f8a90c01. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating instance_info_cache with network_info: [{"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:28:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bed355ec-f2d9-4bf5-9bb1-418d5e6b9197 req-f92a041d-df18-4283-ac95-4102f0a5f896 service nova] Releasing lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:28:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.044s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:15 user nova-compute[72904]: INFO nova.compute.manager [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Attaching volume bbe5a23a-7deb-40fa-b246-4aec498aef38 to /dev/vdb
Aug 27 05:28:15 user nova-compute[72904]: DEBUG os_brick.utils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b4074a-3706-4a8b-bffe-ec3cfe68892d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab37786-dbb8-4234-b64a-26c3034aa0b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5c046a-1b5b-4aae-9291-db8ed05e6831]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[82777f35-5b71-4a1a-82ca-df9b2e45035a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:28:15 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:28:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a9ed42-d095-45eb-a444-8dfa5756f0f7]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG os_brick.utils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:28:15 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating existing volume attachment record: e73bff8b-fcb6-409f-8455-73243bb6c7ec {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:28:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjoBTQFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:28:26 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:28:26 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:28:26 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4139b04-4bdc-4843-abaa-4645f1358b30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:28:26 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d8799b-04c4-4d25-a34e-24fa156940b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38] added
Aug 27 05:28:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee78369b-74ca-482d-a617-de962ebfd893]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b714803-c9a6-4502-83c3-343bda630159]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjoBTQFY {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sjoBTQFY" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[304245ba-9521-4eba-88d2-09a8fcf251fa]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sjoBTQFY'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea729b1e-0f95-46a0-9ca1-1f8f83a73caf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9257eb0-60fe-4dd4-8bb4-5ab976d99d80]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:28:26 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:28:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:28:26 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:28:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd78f7b4-dc58-49d7-9ff3-46d70a9c2bae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260]
Aug 27 05:28:26 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260] successful.
Aug 27 05:28:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[43277b72-aeae-40a9-9925-4d75491832c5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac22c39-dc82-434e-bcc1-88f8311d58af]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:28:26 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:28:26 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:28:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:28:26 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:28:26 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:28:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5623909c-69ae-4e44-a8d2-bc544b776b0e]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:28:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjoBTQFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:28:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:28:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26431646536643861', 'path': '/dev/sdd'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:28:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431646536643861', 'path': '/dev/sdd'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:28:27 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:28:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:28:27 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:28:27 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:28:27 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:28:27 user nova-compute[72904]:   <serial>bbe5a23a-7deb-40fa-b246-4aec498aef38</serial>
Aug 27 05:28:27 user nova-compute[72904]: </disk>
Aug 27 05:28:27 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:28:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:28:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:28:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No VIF found with MAC fa:16:3e:4a:6f:e8, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:28:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a18ca6a1-1c13-4d61-a214-563c4b30a359 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.150s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "3d5d7640-2632-4687-b8e0-3fced65e0e22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:28:32 user nova-compute[72904]: INFO nova.compute.claims [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Claim successful on node user
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:28:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:28:32 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Creating image(s)
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:32 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG nova.policy [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008a26244e704805b8f77410645a4e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63127190a4ad4846892961f9785fb132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.250s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk 1073741824" returned: 0 in 0.059s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Cannot resize image /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Ensure instance console log exists: /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Successfully created port: 96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Successfully updated port: 96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquired lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-changed-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG nova.compute.manager [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Refreshing instance network info cache due to event network-changed-96b6a3e9-5386-4acd-89bc-2c629226e610. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] Acquiring lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:28:34 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.neutron [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Updating instance_info_cache with network_info: [{"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Releasing lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Instance network_info: |[{"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] Acquired lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Refreshing network info cache for port 96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Start _get_guest_xml network_info=[{"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:28:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:28:35 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963933952',display_name='tempest-AttachVolumeNegativeTest-server-963933952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963933952',id=42,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFX3rl3leCPRkbXi0D2MCfBtyGI713HSXmpYCXZAm1oymbZvtfZgkATz1egsoX6aqdtsdQNFWYQyOiYi0+LhaJJY1yLAltqBPoB1fjeTasB6GE6bwWDwxsUMwOaQUUBsw==',key_name='tempest-keypair-1339347649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-7p86sh7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=3d5d7640-2632-4687-b8e0-3fced65e0e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:99:38,bridge_name='br-int',has_traffic_filtering=True,id=96b6a3e9-5386-4acd-89bc-2c629226e610,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b6a3e9-53') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.objects.instance [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d5d7640-2632-4687-b8e0-3fced65e0e22 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:28:35 user nova-compute[72904]:   <uuid>3d5d7640-2632-4687-b8e0-3fced65e0e22</uuid>
Aug 27 05:28:35 user nova-compute[72904]:   <name>instance-0000002a</name>
Aug 27 05:28:35 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:28:35 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:28:35 user nova-compute[72904]:   <metadata>
Aug 27 05:28:35 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:28:35 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:28:35 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeNegativeTest-server-963933952</nova:name>
Aug 27 05:28:35 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:28:35</nova:creationTime>
Aug 27 05:28:35 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:28:35 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:28:35 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:28:35 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:28:35 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:28:35 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:28:35 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:28:35 user nova-compute[72904]:       <nova:owner>
Aug 27 05:28:35 user nova-compute[72904]:         <nova:user uuid="008a26244e704805b8f77410645a4e7f">tempest-AttachVolumeNegativeTest-159688162-project-member</nova:user>
Aug 27 05:28:35 user nova-compute[72904]:         <nova:project uuid="63127190a4ad4846892961f9785fb132">tempest-AttachVolumeNegativeTest-159688162</nova:project>
Aug 27 05:28:35 user nova-compute[72904]:       </nova:owner>
Aug 27 05:28:35 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:28:35 user nova-compute[72904]:       <nova:ports>
Aug 27 05:28:35 user nova-compute[72904]:         <nova:port uuid="96b6a3e9-5386-4acd-89bc-2c629226e610">
Aug 27 05:28:35 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 05:28:35 user nova-compute[72904]:         </nova:port>
Aug 27 05:28:35 user nova-compute[72904]:       </nova:ports>
Aug 27 05:28:35 user nova-compute[72904]:     </nova:instance>
Aug 27 05:28:35 user nova-compute[72904]:   </metadata>
Aug 27 05:28:35 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:28:35 user nova-compute[72904]:     <system>
Aug 27 05:28:35 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:28:35 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:28:35 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:28:35 user nova-compute[72904]:       <entry name="serial">3d5d7640-2632-4687-b8e0-3fced65e0e22</entry>
Aug 27 05:28:35 user nova-compute[72904]:       <entry name="uuid">3d5d7640-2632-4687-b8e0-3fced65e0e22</entry>
Aug 27 05:28:35 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:28:35 user nova-compute[72904]:     </system>
Aug 27 05:28:35 user nova-compute[72904]:   </sysinfo>
Aug 27 05:28:35 user nova-compute[72904]:   <os>
Aug 27 05:28:35 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:28:35 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:28:35 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:28:35 user nova-compute[72904]:   </os>
Aug 27 05:28:35 user nova-compute[72904]:   <features>
Aug 27 05:28:35 user nova-compute[72904]:     <acpi/>
Aug 27 05:28:35 user nova-compute[72904]:     <apic/>
Aug 27 05:28:35 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:28:35 user nova-compute[72904]:   </features>
Aug 27 05:28:35 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:28:35 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:28:35 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:28:35 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:28:35 user nova-compute[72904]:   </clock>
Aug 27 05:28:35 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:28:35 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:28:35 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:28:35 user nova-compute[72904]:   </cpu>
Aug 27 05:28:35 user nova-compute[72904]:   <devices>
Aug 27 05:28:35 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:28:35 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:28:35 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk"/>
Aug 27 05:28:35 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:28:35 user nova-compute[72904]:     </disk>
Aug 27 05:28:35 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:28:35 user nova-compute[72904]:       <mac address="fa:16:3e:49:99:38"/>
Aug 27 05:28:35 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:28:35 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:28:35 user nova-compute[72904]:       <target dev="tap96b6a3e9-53"/>
Aug 27 05:28:35 user nova-compute[72904]:     </interface>
Aug 27 05:28:35 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:28:35 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/console.log" append="off"/>
Aug 27 05:28:35 user nova-compute[72904]:     </serial>
Aug 27 05:28:35 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:28:35 user nova-compute[72904]:     <video>
Aug 27 05:28:35 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:28:35 user nova-compute[72904]:     </video>
Aug 27 05:28:35 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:28:35 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:28:35 user nova-compute[72904]:     </rng>
Aug 27 05:28:35 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:28:35 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:28:35 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:28:35 user nova-compute[72904]:     </memballoon>
Aug 27 05:28:35 user nova-compute[72904]:   </devices>
Aug 27 05:28:35 user nova-compute[72904]: </domain>
Aug 27 05:28:35 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963933952',display_name='tempest-AttachVolumeNegativeTest-server-963933952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963933952',id=42,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFX3rl3leCPRkbXi0D2MCfBtyGI713HSXmpYCXZAm1oymbZvtfZgkATz1egsoX6aqdtsdQNFWYQyOiYi0+LhaJJY1yLAltqBPoB1fjeTasB6GE6bwWDwxsUMwOaQUUBsw==',key_name='tempest-keypair-1339347649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-7p86sh7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=3d5d7640-2632-4687-b8e0-3fced65e0e22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:99:38,bridge_name='br-int',has_traffic_filtering=True,id=96b6a3e9-5386-4acd-89bc-2c629226e610,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b6a3e9-53') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG os_vif [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:99:38,bridge_name='br-int',has_traffic_filtering=True,id=96b6a3e9-5386-4acd-89bc-2c629226e610,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b6a3e9-53') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96b6a3e9-53, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96b6a3e9-53, col_values=(('external_ids', {'iface-id': '96b6a3e9-5386-4acd-89bc-2c629226e610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:99:38', 'vm-uuid': '3d5d7640-2632-4687-b8e0-3fced65e0e22'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:35 user nova-compute[72904]: INFO os_vif [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:99:38,bridge_name='br-int',has_traffic_filtering=True,id=96b6a3e9-5386-4acd-89bc-2c629226e610,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b6a3e9-53')
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No VIF found with MAC fa:16:3e:49:99:38, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Updated VIF entry in instance network info cache for port 96b6a3e9-5386-4acd-89bc-2c629226e610. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Updating instance_info_cache with network_info: [{"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:28:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-15f969ba-009a-45a1-82de-e01b22605433 req-d31f104b-b7f9-4291-96b5-59a61e9c71a9 service nova] Releasing lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-572eeb1b-e2eb-4f98-b1d5-c6cc661a1a38 req-694abaa5-126c-40eb-97db-d599475100b6 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-572eeb1b-e2eb-4f98-b1d5-c6cc661a1a38 req-694abaa5-126c-40eb-97db-d599475100b6 service nova] Acquiring lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-572eeb1b-e2eb-4f98-b1d5-c6cc661a1a38 req-694abaa5-126c-40eb-97db-d599475100b6 service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-572eeb1b-e2eb-4f98-b1d5-c6cc661a1a38 req-694abaa5-126c-40eb-97db-d599475100b6 service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-572eeb1b-e2eb-4f98-b1d5-c6cc661a1a38 req-694abaa5-126c-40eb-97db-d599475100b6 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] No waiting events found dispatching network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:28:36 user nova-compute[72904]: WARNING nova.compute.manager [req-572eeb1b-e2eb-4f98-b1d5-c6cc661a1a38 req-694abaa5-126c-40eb-97db-d599475100b6 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received unexpected event network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 for instance with vm_state building and task_state spawning.
Aug 27 05:28:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114118.5764437, 3d5d7640-2632-4687-b8e0-3fced65e0e22 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:28:38 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] VM Resumed (Lifecycle Event)
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:28:38 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Instance spawned successfully.
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:28:38 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114118.5784621, 3d5d7640-2632-4687-b8e0-3fced65e0e22 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:28:38 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] VM Started (Lifecycle Event)
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:28:38 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:28:38 user nova-compute[72904]: INFO nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:28:38 user nova-compute[72904]: INFO nova.compute.manager [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Took 6.43 seconds to build instance.
Aug 27 05:28:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-eb43e531-c52e-4735-8fb5-18cd705f06c0 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.527s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-10130bf8-fd08-4baf-a3df-b262b91f2025 req-9463c97b-af40-470e-b586-169ea8cba48c service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-10130bf8-fd08-4baf-a3df-b262b91f2025 req-9463c97b-af40-470e-b586-169ea8cba48c service nova] Acquiring lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-10130bf8-fd08-4baf-a3df-b262b91f2025 req-9463c97b-af40-470e-b586-169ea8cba48c service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-10130bf8-fd08-4baf-a3df-b262b91f2025 req-9463c97b-af40-470e-b586-169ea8cba48c service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-10130bf8-fd08-4baf-a3df-b262b91f2025 req-9463c97b-af40-470e-b586-169ea8cba48c service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] No waiting events found dispatching network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:28:38 user nova-compute[72904]: WARNING nova.compute.manager [req-10130bf8-fd08-4baf-a3df-b262b91f2025 req-9463c97b-af40-470e-b586-169ea8cba48c service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received unexpected event network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 for instance with vm_state active and task_state None.
Aug 27 05:28:39 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:28:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:28:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:28:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:28:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=25.40011215209961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:28:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bc93c9f1-59c7-4c48-9677-c74173f3c122 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0d885076-587e-42ff-b0e4-295860b5bc75 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0a4e81cc-431f-422f-9222-77f052490a01 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3d5d7640-2632-4687-b8e0-3fced65e0e22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:28:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:28:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:46 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:46 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:28:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:28:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:28:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:28:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:28:52 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:28:53 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating instance_info_cache with network_info: [{"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:28:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:28:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:28:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:28:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:28:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-changed-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:01 user nova-compute[72904]: DEBUG nova.compute.manager [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Refreshing instance network info cache due to event network-changed-007384cf-88fd-4e73-9c0d-5d8d217060cd. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:29:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] Acquiring lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:29:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] Acquired lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:29:01 user nova-compute[72904]: DEBUG nova.network.neutron [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Refreshing network info cache for port 007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:29:01 user nova-compute[72904]: DEBUG nova.network.neutron [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updated VIF entry in instance network info cache for port 007384cf-88fd-4e73-9c0d-5d8d217060cd. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:29:01 user nova-compute[72904]: DEBUG nova.network.neutron [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating instance_info_cache with network_info: [{"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7b9a2b5-cb52-4aa2-90ce-11543a406048 req-1ee7e4b1-bd68-4920-adb2-bdf099054687 service nova] Releasing lock "refresh_cache-0d885076-587e-42ff-b0e4-295860b5bc75" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:02 user nova-compute[72904]: INFO nova.compute.manager [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Rebuilding instance
Aug 27 05:29:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-c30e869f-caad-4140-ae0a-60ece035d49a req-8e093dd5-3988-4f7c-8ef8-6bc6d996d5e5 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-unplugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c30e869f-caad-4140-ae0a-60ece035d49a req-8e093dd5-3988-4f7c-8ef8-6bc6d996d5e5 service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c30e869f-caad-4140-ae0a-60ece035d49a req-8e093dd5-3988-4f7c-8ef8-6bc6d996d5e5 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c30e869f-caad-4140-ae0a-60ece035d49a req-8e093dd5-3988-4f7c-8ef8-6bc6d996d5e5 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-c30e869f-caad-4140-ae0a-60ece035d49a req-8e093dd5-3988-4f7c-8ef8-6bc6d996d5e5 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No waiting events found dispatching network-vif-unplugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:29:02 user nova-compute[72904]: WARNING nova.compute.manager [req-c30e869f-caad-4140-ae0a-60ece035d49a req-8e093dd5-3988-4f7c-8ef8-6bc6d996d5e5 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received unexpected event network-vif-unplugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with vm_state active and task_state rebuilding.
Aug 27 05:29:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:03 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance destroyed successfully.
Aug 27 05:29:03 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance destroyed successfully.
Aug 27 05:29:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1756367419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-363355423',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB41jIEta1Wjr2W1L1neBnORvuhB9kUCKDt9im7ZtangeVumN2WkX6YS0ZpXTz198bq+o7nF+6Zi+WqUKUkU2zWvq2qzOcw+O5CJIsb7yGjixKzc9Qee4rwCkUirc9/o9A==',key_name='tempest-keypair-1288777666',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:27:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aad2ad0b23fa4d94a54465cf73502f0e',ramdisk_id='',reservation_id='r-1opq4zxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-168812509',owner_user_name='tempest-ServerActionsV293TestJSON-168812509-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:29:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c0f942b9b2c4fb58c83f0f5b8edc69e',uuid=0d885076-587e-42ff-b0e4-295860b5bc75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converting VIF {"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_vif [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007384cf-88, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:03 user nova-compute[72904]: INFO os_vif [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88')
Aug 27 05:29:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:29:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[14461439-cf2c-4623-ae50-4ac71c275038]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[669cb63b-5465-4048-beb4-3da8546bed7e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:29:03 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:29:03 user nova-compute[72904]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194467910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3004cc-eb4f-46a2-a209-33c89963f4c9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b4797f-2c79-4ee0-88e9-a0dad2b3cd9c]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[88687344-4093-4d68-ae02-d32994a7bd7f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[609d9c2f-8b7d-4f84-90cb-b5cc43c495d3]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aff687-bdec-4eb9-b1fa-a35a1dc4a1a8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9328bcf1-ef30-4886-9145-7aa85a7206b1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]
Aug 27 05:29:03 user nova-compute[72904]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.
Aug 27 05:29:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f14c1b4-c4ab-4e10-99cd-d19677bcefde]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] <== disconnect_volume: return (297ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:29:03 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Deleting instance files /opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75_del
Aug 27 05:29:03 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Deletion of /opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75_del complete
Aug 27 05:29:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 0d885076-587e-42ff-b0e4-295860b5bc75 could not be found.
Aug 27 05:29:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:29:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aed8fc-cd0b-4cdf-8372-a9350b97a6cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[da942bb4-cf9e-4006-9535-52ad6d1d4f7e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c59bac0>, {}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Disconnecting from: [] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.045s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] <== disconnect_volume: return (47ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:29:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Preparing to wait for external event volume-reimaged-53a8e5f7-7bf8-4d55-9aea-5106b4130a3e {{(pid=72904) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-396e8b1a-1d7c-4b0d-8d1b-7cde88c2108f req-d77a5d08-7576-4c0a-8b0c-5d45e0477947 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-396e8b1a-1d7c-4b0d-8d1b-7cde88c2108f req-d77a5d08-7576-4c0a-8b0c-5d45e0477947 service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-396e8b1a-1d7c-4b0d-8d1b-7cde88c2108f req-d77a5d08-7576-4c0a-8b0c-5d45e0477947 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-396e8b1a-1d7c-4b0d-8d1b-7cde88c2108f req-d77a5d08-7576-4c0a-8b0c-5d45e0477947 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-396e8b1a-1d7c-4b0d-8d1b-7cde88c2108f req-d77a5d08-7576-4c0a-8b0c-5d45e0477947 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No event matching network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd in dict_keys([('volume-reimaged', '53a8e5f7-7bf8-4d55-9aea-5106b4130a3e')]) {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 27 05:29:04 user nova-compute[72904]: WARNING nova.compute.manager [req-396e8b1a-1d7c-4b0d-8d1b-7cde88c2108f req-d77a5d08-7576-4c0a-8b0c-5d45e0477947 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received unexpected event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with vm_state active and task_state rebuilding.
Aug 27 05:29:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "0a4e81cc-431f-422f-9222-77f052490a01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "0a4e81cc-431f-422f-9222-77f052490a01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "0a4e81cc-431f-422f-9222-77f052490a01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:14 user nova-compute[72904]: INFO nova.compute.manager [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Terminating instance
Aug 27 05:29:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-21964a64-71dc-42a1-97b1-4936305f8b2f req-c98d1438-57e9-4e6f-8fd1-9654bebf6b26 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received event network-vif-unplugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-21964a64-71dc-42a1-97b1-4936305f8b2f req-c98d1438-57e9-4e6f-8fd1-9654bebf6b26 service nova] Acquiring lock "0a4e81cc-431f-422f-9222-77f052490a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-21964a64-71dc-42a1-97b1-4936305f8b2f req-c98d1438-57e9-4e6f-8fd1-9654bebf6b26 service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-21964a64-71dc-42a1-97b1-4936305f8b2f req-c98d1438-57e9-4e6f-8fd1-9654bebf6b26 service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-21964a64-71dc-42a1-97b1-4936305f8b2f req-c98d1438-57e9-4e6f-8fd1-9654bebf6b26 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] No waiting events found dispatching network-vif-unplugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:29:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-21964a64-71dc-42a1-97b1-4936305f8b2f req-c98d1438-57e9-4e6f-8fd1-9654bebf6b26 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received event network-vif-unplugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:29:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Instance destroyed successfully.
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.objects.instance [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'resources' on Instance uuid 0a4e81cc-431f-422f-9222-77f052490a01 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:27:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-856689202',display_name='tempest-TestVolumeBootPattern-server-856689202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-856689202',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-vcpb0e2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:27:49Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=0a4e81cc-431f-422f-9222-77f052490a01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "address": "fa:16:3e:da:1c:81", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcad154-dd", "ovs_interfaceid": "8bcad154-dda9-45dd-9e9f-40dc5e976c01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:1c:81,bridge_name='br-int',has_traffic_filtering=True,id=8bcad154-dda9-45dd-9e9f-40dc5e976c01,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcad154-dd') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_vif [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:1c:81,bridge_name='br-int',has_traffic_filtering=True,id=8bcad154-dda9-45dd-9e9f-40dc5e976c01,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcad154-dd') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bcad154-dd, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:15 user nova-compute[72904]: INFO os_vif [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:1c:81,bridge_name='br-int',has_traffic_filtering=True,id=8bcad154-dda9-45dd-9e9f-40dc5e976c01,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcad154-dd')
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gTsajDSm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:29:15 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[93074025-4257-4620-890f-15aaa43407bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a2f97-3f23-49e7-ace2-8c64cde47b29]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:29:15 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 (non-flash)
Aug 27 05:29:15 user nova-compute[72904]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c59ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8'): ({'sdc'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Removing single pathed devices sdc {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d97124c-ffc8-4398-9804-44a2011ce374]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcb5680-3ae3-4eda-b84b-a5168421c295]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flushing IO for device /dev/sdc {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf30539-df3a-4d08-ba1a-aa82b37fc277]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d012819-c1a4-4eb9-b56a-d3a76796a9c5]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23265623933653336', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bde73958', '/dev/disk/by-id/scsi-1SCST_BIObde73958-2eb93e369f70649b') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d932a42-2cae-49f7-b482-1605b0bbaa5a]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f63924-484a-47ca-9aef-c7d308cb8bd7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df9f5e-515a-4137-8270-6d07f090f83b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260]
Aug 27 05:29:15 user nova-compute[72904]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8, portal: 172.16.0.220,3260] successful.
Aug 27 05:29:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7994d34-8224-428b-b34e-cc825a78bfb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f457bd-44e6-4b39-b514-658f62ed0314]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== disconnect_volume: return (286ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:29:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Deleting instance files /opt/stack/data/nova/instances/0a4e81cc-431f-422f-9222-77f052490a01_del
Aug 27 05:29:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Deletion of /opt/stack/data/nova/instances/0a4e81cc-431f-422f-9222-77f052490a01_del complete
Aug 27 05:29:15 user nova-compute[72904]: INFO nova.compute.manager [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 27 05:29:15 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:29:15 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Took 0.53 seconds to deallocate network for instance.
Aug 27 05:29:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-2fdea633-6633-4bf7-a063-d9248ab57b1f req-c843b4bf-7e5a-4ea4-aa16-6756670a720c service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received event network-vif-deleted-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-3a59a997-0d5b-48a0-80a5-73d4f3203ea7 req-a353edcc-a75f-42cb-a772-494826653db6 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received event network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3a59a997-0d5b-48a0-80a5-73d4f3203ea7 req-a353edcc-a75f-42cb-a772-494826653db6 service nova] Acquiring lock "0a4e81cc-431f-422f-9222-77f052490a01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3a59a997-0d5b-48a0-80a5-73d4f3203ea7 req-a353edcc-a75f-42cb-a772-494826653db6 service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3a59a997-0d5b-48a0-80a5-73d4f3203ea7 req-a353edcc-a75f-42cb-a772-494826653db6 service nova] Lock "0a4e81cc-431f-422f-9222-77f052490a01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:16 user nova-compute[72904]: DEBUG nova.compute.manager [req-3a59a997-0d5b-48a0-80a5-73d4f3203ea7 req-a353edcc-a75f-42cb-a772-494826653db6 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] No waiting events found dispatching network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:29:16 user nova-compute[72904]: WARNING nova.compute.manager [req-3a59a997-0d5b-48a0-80a5-73d4f3203ea7 req-a353edcc-a75f-42cb-a772-494826653db6 service nova] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Received unexpected event network-vif-plugged-8bcad154-dda9-45dd-9e9f-40dc5e976c01 for instance with vm_state active and task_state deleting.
Aug 27 05:29:16 user nova-compute[72904]: INFO nova.compute.manager [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Took 0.77 seconds to detach 1 volumes for instance.
Aug 27 05:29:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Deleting volume: f7994d34-8224-428b-b34e-cc825a78bfb8 {{(pid=72904) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 05:29:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:17 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:29:17 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:29:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:17 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Deleted allocations for instance 0a4e81cc-431f-422f-9222-77f052490a01
Aug 27 05:29:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8f69c5f1-974a-45d8-bbc0-e0250629fefb tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "0a4e81cc-431f-422f-9222-77f052490a01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:18 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114143.3289657, 0d885076-587e-42ff-b0e4-295860b5bc75 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:29:18 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] VM Stopped (Lifecycle Event)
Aug 27 05:29:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-abbc6237-7cf3-4233-8fe4-c76e95b1a2ee None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:29:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:29:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:29:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:29:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:30 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114155.012808, 0a4e81cc-431f-422f-9222-77f052490a01 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:29:30 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] VM Stopped (Lifecycle Event)
Aug 27 05:29:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f57f9c61-3ac3-4d4f-badf-e59b852574b7 None None] [instance: 0a4e81cc-431f-422f-9222-77f052490a01] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:29:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:29:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:29:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:29:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-a4cbd1a3-3025-484d-9de9-307d564409f8 req-05fb69ce-9fd4-4b2e-abf9-213c3fc1dcfc service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event volume-reimaged-53a8e5f7-7bf8-4d55-9aea-5106b4130a3e {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a4cbd1a3-3025-484d-9de9-307d564409f8 req-05fb69ce-9fd4-4b2e-abf9-213c3fc1dcfc service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a4cbd1a3-3025-484d-9de9-307d564409f8 req-05fb69ce-9fd4-4b2e-abf9-213c3fc1dcfc service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a4cbd1a3-3025-484d-9de9-307d564409f8 req-05fb69ce-9fd4-4b2e-abf9-213c3fc1dcfc service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-a4cbd1a3-3025-484d-9de9-307d564409f8 req-05fb69ce-9fd4-4b2e-abf9-213c3fc1dcfc service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Processing event volume-reimaged-53a8e5f7-7bf8-4d55-9aea-5106b4130a3e {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance event wait completed in 28 seconds for volume-reimaged {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:29:33 user nova-compute[72904]: INFO nova.virt.block_device [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Booting with volume 53a8e5f7-7bf8-4d55-9aea-5106b4130a3e at /dev/vda
Aug 27 05:29:33 user nova-compute[72904]: DEBUG os_brick.utils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d067f4-bd90-442c-bab4-68b07b9c67a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dee678a-fb40-49c8-b86a-cc26bebc02a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c56d98-72dc-4610-ba19-53254ae2ae7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2589be-4618-476e-bb92-a451e0091af5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:29:33 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:29:33 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c75d3a9-fed5-4059-9f38-444282cc62cb]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG os_brick.utils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:29:33 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating existing volume attachment record: 883591c6-0eb7-4b18-bf51-340eb737210d {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:29:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:29:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:29:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:29:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8572MB free_disk=25.370906829833984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bc93c9f1-59c7-4c48-9677-c74173f3c122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0d885076-587e-42ff-b0e4-295860b5bc75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 3d5d7640-2632-4687-b8e0-3fced65e0e22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:29:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:29:44 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Creating image(s)
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Ensure instance console log exists: /opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Start _get_guest_xml network_info=[{"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '883591c6-0eb7-4b18-bf51-340eb737210d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0d885076-587e-42ff-b0e4-295860b5bc75', 'attached_at': '', 'detached_at': '', 'volume_id': '53a8e5f7-7bf8-4d55-9aea-5106b4130a3e', 'serial': '53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:29:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 05:29:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0d885076-587e-42ff-b0e4-295860b5bc75 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:29:44 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:29:44 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:29:44 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8526d2c-c467-4997-9561-9e14f3e0629e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:29:44 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f09457b-e215-4267-a5c5-363723c18704]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e] added
Aug 27 05:29:44 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bb0de0-a9f3-4b1d-b761-d33846be19fb]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea40171e-412a-405f-b6b5-d0b7cbdb8519]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFpEOZQN {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PFpEOZQN" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d016a7dd-935c-41d9-841c-e2cffe4135b6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PFpEOZQN'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c80fce-05a8-4acb-a509-1bb4923a23dc]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba707b4-c64e-4307-ab4a-7e2438b8670e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[605028d7-5144-46f8-b08d-2d21aa3ba587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]
Aug 27 05:29:45 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.
Aug 27 05:29:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8653abd2-5f69-4f6a-bea6-9f6a8fd983be]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d00ff98-8d51-4f02-a001-8d2df05ecc35]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:45 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:29:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:29:45 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:29:45 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e8d1e-5035-41ae-84fb-1135bbd31276]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:29:45 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23832323939326434', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832323939326434', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1756367419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-363355423',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB41jIEta1Wjr2W1L1neBnORvuhB9kUCKDt9im7ZtangeVumN2WkX6YS0ZpXTz198bq+o7nF+6Zi+WqUKUkU2zWvq2qzOcw+O5CJIsb7yGjixKzc9Qee4rwCkUirc9/o9A==',key_name='tempest-keypair-1288777666',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:27:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aad2ad0b23fa4d94a54465cf73502f0e',ramdisk_id='',reservation_id='r-1opq4zxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-168812509',owner_user_name='tempest-ServerActionsV293TestJSON-168812509-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c0f942b9b2c4fb58c83f0f5b8edc69e',uuid=0d885076-587e-42ff-b0e4-295860b5bc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converting VIF {"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:29:46 user nova-compute[72904]:   <uuid>0d885076-587e-42ff-b0e4-295860b5bc75</uuid>
Aug 27 05:29:46 user nova-compute[72904]:   <name>instance-00000028</name>
Aug 27 05:29:46 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:29:46 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:29:46 user nova-compute[72904]:   <metadata>
Aug 27 05:29:46 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:29:46 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:29:46 user nova-compute[72904]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1756367419</nova:name>
Aug 27 05:29:46 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:29:44</nova:creationTime>
Aug 27 05:29:46 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:29:46 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:29:46 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:29:46 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:29:46 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:29:46 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:29:46 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:29:46 user nova-compute[72904]:       <nova:owner>
Aug 27 05:29:46 user nova-compute[72904]:         <nova:user uuid="5c0f942b9b2c4fb58c83f0f5b8edc69e">tempest-ServerActionsV293TestJSON-168812509-project-member</nova:user>
Aug 27 05:29:46 user nova-compute[72904]:         <nova:project uuid="aad2ad0b23fa4d94a54465cf73502f0e">tempest-ServerActionsV293TestJSON-168812509</nova:project>
Aug 27 05:29:46 user nova-compute[72904]:       </nova:owner>
Aug 27 05:29:46 user nova-compute[72904]:       <nova:ports>
Aug 27 05:29:46 user nova-compute[72904]:         <nova:port uuid="007384cf-88fd-4e73-9c0d-5d8d217060cd">
Aug 27 05:29:46 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:29:46 user nova-compute[72904]:         </nova:port>
Aug 27 05:29:46 user nova-compute[72904]:       </nova:ports>
Aug 27 05:29:46 user nova-compute[72904]:     </nova:instance>
Aug 27 05:29:46 user nova-compute[72904]:   </metadata>
Aug 27 05:29:46 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:29:46 user nova-compute[72904]:     <system>
Aug 27 05:29:46 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:29:46 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:29:46 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:29:46 user nova-compute[72904]:       <entry name="serial">0d885076-587e-42ff-b0e4-295860b5bc75</entry>
Aug 27 05:29:46 user nova-compute[72904]:       <entry name="uuid">0d885076-587e-42ff-b0e4-295860b5bc75</entry>
Aug 27 05:29:46 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:29:46 user nova-compute[72904]:     </system>
Aug 27 05:29:46 user nova-compute[72904]:   </sysinfo>
Aug 27 05:29:46 user nova-compute[72904]:   <os>
Aug 27 05:29:46 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:29:46 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:29:46 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:29:46 user nova-compute[72904]:   </os>
Aug 27 05:29:46 user nova-compute[72904]:   <features>
Aug 27 05:29:46 user nova-compute[72904]:     <acpi/>
Aug 27 05:29:46 user nova-compute[72904]:     <apic/>
Aug 27 05:29:46 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:29:46 user nova-compute[72904]:   </features>
Aug 27 05:29:46 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:29:46 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:29:46 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:29:46 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:29:46 user nova-compute[72904]:   </clock>
Aug 27 05:29:46 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:29:46 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:29:46 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:29:46 user nova-compute[72904]:   </cpu>
Aug 27 05:29:46 user nova-compute[72904]:   <devices>
Aug 27 05:29:46 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:29:46 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:29:46 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:29:46 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:29:46 user nova-compute[72904]:       <serial>53a8e5f7-7bf8-4d55-9aea-5106b4130a3e</serial>
Aug 27 05:29:46 user nova-compute[72904]:     </disk>
Aug 27 05:29:46 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:29:46 user nova-compute[72904]:       <mac address="fa:16:3e:e0:a8:c8"/>
Aug 27 05:29:46 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:29:46 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:29:46 user nova-compute[72904]:       <target dev="tap007384cf-88"/>
Aug 27 05:29:46 user nova-compute[72904]:     </interface>
Aug 27 05:29:46 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:29:46 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75/console.log" append="off"/>
Aug 27 05:29:46 user nova-compute[72904]:     </serial>
Aug 27 05:29:46 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:29:46 user nova-compute[72904]:     <video>
Aug 27 05:29:46 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:29:46 user nova-compute[72904]:     </video>
Aug 27 05:29:46 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:29:46 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:29:46 user nova-compute[72904]:     </rng>
Aug 27 05:29:46 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:29:46 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:29:46 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:29:46 user nova-compute[72904]:     </memballoon>
Aug 27 05:29:46 user nova-compute[72904]:   </devices>
Aug 27 05:29:46 user nova-compute[72904]: </domain>
Aug 27 05:29:46 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1756367419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-363355423',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB41jIEta1Wjr2W1L1neBnORvuhB9kUCKDt9im7ZtangeVumN2WkX6YS0ZpXTz198bq+o7nF+6Zi+WqUKUkU2zWvq2qzOcw+O5CJIsb7yGjixKzc9Qee4rwCkUirc9/o9A==',key_name='tempest-keypair-1288777666',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:27:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aad2ad0b23fa4d94a54465cf73502f0e',ramdisk_id='',reservation_id='r-1opq4zxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-168812509',owner_user_name='tempest-ServerActionsV293TestJSON-168812509-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:29:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c0f942b9b2c4fb58c83f0f5b8edc69e',uuid=0d885076-587e-42ff-b0e4-295860b5bc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converting VIF {"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG os_vif [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007384cf-88, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap007384cf-88, col_values=(('external_ids', {'iface-id': '007384cf-88fd-4e73-9c0d-5d8d217060cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:a8:c8', 'vm-uuid': '0d885076-587e-42ff-b0e4-295860b5bc75'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:46 user nova-compute[72904]: INFO os_vif [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88')
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:29:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] No VIF found with MAC fa:16:3e:e0:a8:c8, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-8f812161-51bd-4896-9132-5240f6fd00f1 req-ba99b0c3-ab2d-4ca3-8a71-fcb4b7d19b4f service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f812161-51bd-4896-9132-5240f6fd00f1 req-ba99b0c3-ab2d-4ca3-8a71-fcb4b7d19b4f service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f812161-51bd-4896-9132-5240f6fd00f1 req-ba99b0c3-ab2d-4ca3-8a71-fcb4b7d19b4f service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8f812161-51bd-4896-9132-5240f6fd00f1 req-ba99b0c3-ab2d-4ca3-8a71-fcb4b7d19b4f service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-8f812161-51bd-4896-9132-5240f6fd00f1 req-ba99b0c3-ab2d-4ca3-8a71-fcb4b7d19b4f service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No waiting events found dispatching network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:29:47 user nova-compute[72904]: WARNING nova.compute.manager [req-8f812161-51bd-4896-9132-5240f6fd00f1 req-ba99b0c3-ab2d-4ca3-8a71-fcb4b7d19b4f service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received unexpected event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with vm_state active and task_state rebuild_spawning.
Aug 27 05:29:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114189.5974364, 0d885076-587e-42ff-b0e4-295860b5bc75 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:29:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] VM Resumed (Lifecycle Event)
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:29:49 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance spawned successfully.
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:29:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114189.5987608, 0d885076-587e-42ff-b0e4-295860b5bc75 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:29:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] VM Started (Lifecycle Event)
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:29:49 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72904) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a4cbd1a3-3025-484d-9de9-307d564409f8 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.067s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-d336c2ad-6134-421c-827e-53a1c5cf8f3a req-8720c517-89c0-41de-82d0-ee82ee555165 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d336c2ad-6134-421c-827e-53a1c5cf8f3a req-8720c517-89c0-41de-82d0-ee82ee555165 service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d336c2ad-6134-421c-827e-53a1c5cf8f3a req-8720c517-89c0-41de-82d0-ee82ee555165 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d336c2ad-6134-421c-827e-53a1c5cf8f3a req-8720c517-89c0-41de-82d0-ee82ee555165 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:29:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-d336c2ad-6134-421c-827e-53a1c5cf8f3a req-8720c517-89c0-41de-82d0-ee82ee555165 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No waiting events found dispatching network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:29:49 user nova-compute[72904]: WARNING nova.compute.manager [req-d336c2ad-6134-421c-827e-53a1c5cf8f3a req-8720c517-89c0-41de-82d0-ee82ee555165 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received unexpected event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with vm_state active and task_state None.
Aug 27 05:29:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:29:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:29:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:29:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:29:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:30:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:30:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:30:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:30:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:30:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:30:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-changed-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Refreshing instance network info cache due to event network-changed-96b6a3e9-5386-4acd-89bc-2c629226e610. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] Acquiring lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] Acquired lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Refreshing network info cache for port 96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "3d5d7640-2632-4687-b8e0-3fced65e0e22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:23 user nova-compute[72904]: INFO nova.compute.manager [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Terminating instance
Aug 27 05:30:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Updated VIF entry in instance network info cache for port 96b6a3e9-5386-4acd-89bc-2c629226e610. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:30:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Updating instance_info_cache with network_info: [{"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-bf917481-386d-400a-ae28-755630dff21a req-0062492a-2cf4-45bb-b7cf-e5eebd716f35 service nova] Releasing lock "refresh_cache-3d5d7640-2632-4687-b8e0-3fced65e0e22" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-4bbbc247-6457-48e4-88a8-c4b96f0d82b9 req-d7b60d16-e45c-4923-b91f-d10acc4b02ef service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-vif-unplugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4bbbc247-6457-48e4-88a8-c4b96f0d82b9 req-d7b60d16-e45c-4923-b91f-d10acc4b02ef service nova] Acquiring lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4bbbc247-6457-48e4-88a8-c4b96f0d82b9 req-d7b60d16-e45c-4923-b91f-d10acc4b02ef service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-4bbbc247-6457-48e4-88a8-c4b96f0d82b9 req-d7b60d16-e45c-4923-b91f-d10acc4b02ef service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-4bbbc247-6457-48e4-88a8-c4b96f0d82b9 req-d7b60d16-e45c-4923-b91f-d10acc4b02ef service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] No waiting events found dispatching network-vif-unplugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.compute.manager [req-4bbbc247-6457-48e4-88a8-c4b96f0d82b9 req-d7b60d16-e45c-4923-b91f-d10acc4b02ef service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-vif-unplugged-96b6a3e9-5386-4acd-89bc-2c629226e610 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:30:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Instance destroyed successfully.
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'resources' on Instance uuid 3d5d7640-2632-4687-b8e0-3fced65e0e22 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963933952',display_name='tempest-AttachVolumeNegativeTest-server-963933952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963933952',id=42,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFX3rl3leCPRkbXi0D2MCfBtyGI713HSXmpYCXZAm1oymbZvtfZgkATz1egsoX6aqdtsdQNFWYQyOiYi0+LhaJJY1yLAltqBPoB1fjeTasB6GE6bwWDwxsUMwOaQUUBsw==',key_name='tempest-keypair-1339347649',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:28:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-7p86sh7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:28:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=3d5d7640-2632-4687-b8e0-3fced65e0e22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "96b6a3e9-5386-4acd-89bc-2c629226e610", "address": "fa:16:3e:49:99:38", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96b6a3e9-53", "ovs_interfaceid": "96b6a3e9-5386-4acd-89bc-2c629226e610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:99:38,bridge_name='br-int',has_traffic_filtering=True,id=96b6a3e9-5386-4acd-89bc-2c629226e610,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b6a3e9-53') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG os_vif [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:99:38,bridge_name='br-int',has_traffic_filtering=True,id=96b6a3e9-5386-4acd-89bc-2c629226e610,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b6a3e9-53') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96b6a3e9-53, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:24 user nova-compute[72904]: INFO os_vif [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:99:38,bridge_name='br-int',has_traffic_filtering=True,id=96b6a3e9-5386-4acd-89bc-2c629226e610,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96b6a3e9-53')
Aug 27 05:30:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Deleting instance files /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22_del
Aug 27 05:30:24 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Deletion of /opt/stack/data/nova/instances/3d5d7640-2632-4687-b8e0-3fced65e0e22_del complete
Aug 27 05:30:24 user nova-compute[72904]: INFO nova.compute.manager [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 27 05:30:24 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:30:24 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:30:25 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:30:25 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Took 0.87 seconds to deallocate network for instance.
Aug 27 05:30:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:25 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:30:25 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:30:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:25 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Deleted allocations for instance 3d5d7640-2632-4687-b8e0-3fced65e0e22
Aug 27 05:30:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f2066677-7fc0-42c9-b744-5b24ed6c6097 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-ae2817ad-1ae3-4b44-bf46-8c61f98b3ca4 req-5ebe8fd1-3916-4e01-9a1b-b4d9ed8a24cc service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ae2817ad-1ae3-4b44-bf46-8c61f98b3ca4 req-5ebe8fd1-3916-4e01-9a1b-b4d9ed8a24cc service nova] Acquiring lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ae2817ad-1ae3-4b44-bf46-8c61f98b3ca4 req-5ebe8fd1-3916-4e01-9a1b-b4d9ed8a24cc service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ae2817ad-1ae3-4b44-bf46-8c61f98b3ca4 req-5ebe8fd1-3916-4e01-9a1b-b4d9ed8a24cc service nova] Lock "3d5d7640-2632-4687-b8e0-3fced65e0e22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-ae2817ad-1ae3-4b44-bf46-8c61f98b3ca4 req-5ebe8fd1-3916-4e01-9a1b-b4d9ed8a24cc service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] No waiting events found dispatching network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:30:26 user nova-compute[72904]: WARNING nova.compute.manager [req-ae2817ad-1ae3-4b44-bf46-8c61f98b3ca4 req-5ebe8fd1-3916-4e01-9a1b-b4d9ed8a24cc service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received unexpected event network-vif-plugged-96b6a3e9-5386-4acd-89bc-2c629226e610 for instance with vm_state deleted and task_state None.
Aug 27 05:30:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-ae2817ad-1ae3-4b44-bf46-8c61f98b3ca4 req-5ebe8fd1-3916-4e01-9a1b-b4d9ed8a24cc service nova] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Received event network-vif-deleted-96b6a3e9-5386-4acd-89bc-2c629226e610 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "dfce3951-bee5-463e-ac61-031da58e4557" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:30:31 user nova-compute[72904]: INFO nova.compute.claims [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Claim successful on node user
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.215s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:30:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:30:31 user nova-compute[72904]: INFO nova.virt.block_device [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Booting with volume 30a4f3e3-d103-4a2b-a308-845b5ba85454 at /dev/vda
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.policy [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fd6f1e0a2843cca915e52045b78d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41729cc06fa94b569a46e971b769d96f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG os_brick.utils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5a76c-1a90-4982-8c72-a62f50254f63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7574e82-4198-4b0e-857f-b814b3ee33cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0e1397-f481-4c4a-9b27-f16aa89acd96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76014a7b-45be-4b31-bcf8-22f622631f47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:30:31 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:30:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c37045-cad9-44aa-82e1-d9556237aa0a]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG os_brick.utils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:30:31 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating existing volume attachment record: 16e6c1ba-3b68-4951-af1f-651b4cc9f788 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:30:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Successfully created port: e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:30:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Successfully updated port: e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:30:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:30:32 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquired lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:30:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-changed-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Refreshing instance network info cache due to event network-changed-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] Acquiring lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating instance_info_cache with network_info: [{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Releasing lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Instance network_info: |[{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] Acquired lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Refreshing network info cache for port e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updated VIF entry in instance network info cache for port e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating instance_info_cache with network_info: [{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:30:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-230d1605-0e82-4df4-b7f4-8a2d047241a6 req-7ca04ef9-aca7-40de-8096-aeb0a9fc1d00 service nova] Releasing lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:30:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114224.4022162, 3d5d7640-2632-4687-b8e0-3fced65e0e22 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:30:39 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] VM Stopped (Lifecycle Event)
Aug 27 05:30:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-647d75ad-1f00-4258-a9a9-1b0bda988f62 None None] [instance: 3d5d7640-2632-4687-b8e0-3fced65e0e22] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:30:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:30:40 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8557MB free_disk=25.38861083984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bc93c9f1-59c7-4c48-9677-c74173f3c122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 0d885076-587e-42ff-b0e4-295860b5bc75 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance dfce3951-bee5-463e-ac61-031da58e4557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:30:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:30:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Creating image(s)
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Ensure instance console log exists: /opt/stack/data/nova/instances/dfce3951-bee5-463e-ac61-031da58e4557/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Start _get_guest_xml network_info=[{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '16e6c1ba-3b68-4951-af1f-651b4cc9f788', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OrUDSAbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfce3951-bee5-463e-ac61-031da58e4557', 'attached_at': '', 'detached_at': '', 'volume_id': '30a4f3e3-d103-4a2b-a308-845b5ba85454', 'serial': '30a4f3e3-d103-4a2b-a308-845b5ba85454'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:30:42 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:30:42 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OrUDSAbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:30:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:30:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:30:42 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2af5bc-5e6d-4064-9abf-d442e004a8e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:30:42 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de2ac9-4f86-420b-8dd5-eca8ed8f0333]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454] added
Aug 27 05:30:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a110e6c-b7fc-4e17-b9a2-fbc71d1ffb60]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[911104f5-d9a5-4fce-958a-d898b6985bf6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OrUDSAbl {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OrUDSAbl" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf28673-49c1-419e-a4e4-1036632c37d8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OrUDSAbl'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[675f75ee-c042-4c1b-aa1b-7531acd6d4ca]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4726bfb-818c-486c-99bc-ec71ed7c34f2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:30:42 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:30:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:30:42 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:30:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f2e63d-c32a-45dd-97e4-58d96990b8f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260]
Aug 27 05:30:42 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260] successful.
Aug 27 05:30:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68b7a62-bff4-4879-b052-6d8ea9293190]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[07054470-ce67-45d8-ab9a-345432d0a978]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:30:43 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:30:43 user nova-compute[72904]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:30:43 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:30:43 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:30:43 user nova-compute[72904]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:30:43 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e461b6-d4f6-46e9-b81b-df9c65cf267e]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:30:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OrUDSAbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26634656162363632', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634656162363632', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-439146878',display_name='tempest-TestVolumeBootPattern-volume-backed-server-439146878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-439146878',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCC6Qa31FvKYC+/leStcBJGws1n2FNiuOmRF4iHS54D4UiprTzV5am1rljhH9xs4CE6kTgDBtE7XzR6gsQz3sxh84AdXKMMjKpSCXdmag0e8kPe2a5DSl5neo3SxBM5TQ==',key_name='tempest-keypair-1693054271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-01l637fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=dfce3951-bee5-463e-ac61-031da58e4557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b6:fe,bridge_name='br-int',has_traffic_filtering=True,id=e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71f5f4b-a0') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.objects.instance [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'pci_devices' on Instance uuid dfce3951-bee5-463e-ac61-031da58e4557 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:30:44 user nova-compute[72904]:   <uuid>dfce3951-bee5-463e-ac61-031da58e4557</uuid>
Aug 27 05:30:44 user nova-compute[72904]:   <name>instance-0000002b</name>
Aug 27 05:30:44 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:30:44 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:30:44 user nova-compute[72904]:   <metadata>
Aug 27 05:30:44 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:30:44 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:30:44 user nova-compute[72904]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-439146878</nova:name>
Aug 27 05:30:44 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:30:42</nova:creationTime>
Aug 27 05:30:44 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:30:44 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:30:44 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:30:44 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:30:44 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:30:44 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:30:44 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:30:44 user nova-compute[72904]:       <nova:owner>
Aug 27 05:30:44 user nova-compute[72904]:         <nova:user uuid="75fd6f1e0a2843cca915e52045b78d4f">tempest-TestVolumeBootPattern-1154964358-project-member</nova:user>
Aug 27 05:30:44 user nova-compute[72904]:         <nova:project uuid="41729cc06fa94b569a46e971b769d96f">tempest-TestVolumeBootPattern-1154964358</nova:project>
Aug 27 05:30:44 user nova-compute[72904]:       </nova:owner>
Aug 27 05:30:44 user nova-compute[72904]:       <nova:ports>
Aug 27 05:30:44 user nova-compute[72904]:         <nova:port uuid="e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5">
Aug 27 05:30:44 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 27 05:30:44 user nova-compute[72904]:         </nova:port>
Aug 27 05:30:44 user nova-compute[72904]:       </nova:ports>
Aug 27 05:30:44 user nova-compute[72904]:     </nova:instance>
Aug 27 05:30:44 user nova-compute[72904]:   </metadata>
Aug 27 05:30:44 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:30:44 user nova-compute[72904]:     <system>
Aug 27 05:30:44 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:30:44 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:30:44 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:30:44 user nova-compute[72904]:       <entry name="serial">dfce3951-bee5-463e-ac61-031da58e4557</entry>
Aug 27 05:30:44 user nova-compute[72904]:       <entry name="uuid">dfce3951-bee5-463e-ac61-031da58e4557</entry>
Aug 27 05:30:44 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:30:44 user nova-compute[72904]:     </system>
Aug 27 05:30:44 user nova-compute[72904]:   </sysinfo>
Aug 27 05:30:44 user nova-compute[72904]:   <os>
Aug 27 05:30:44 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:30:44 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:30:44 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:30:44 user nova-compute[72904]:   </os>
Aug 27 05:30:44 user nova-compute[72904]:   <features>
Aug 27 05:30:44 user nova-compute[72904]:     <acpi/>
Aug 27 05:30:44 user nova-compute[72904]:     <apic/>
Aug 27 05:30:44 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:30:44 user nova-compute[72904]:   </features>
Aug 27 05:30:44 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:30:44 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:30:44 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:30:44 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:30:44 user nova-compute[72904]:   </clock>
Aug 27 05:30:44 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:30:44 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:30:44 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:30:44 user nova-compute[72904]:   </cpu>
Aug 27 05:30:44 user nova-compute[72904]:   <devices>
Aug 27 05:30:44 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:30:44 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:30:44 user nova-compute[72904]:       <source dev="/dev/sdc"/>
Aug 27 05:30:44 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:30:44 user nova-compute[72904]:       <serial>30a4f3e3-d103-4a2b-a308-845b5ba85454</serial>
Aug 27 05:30:44 user nova-compute[72904]:     </disk>
Aug 27 05:30:44 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:30:44 user nova-compute[72904]:       <mac address="fa:16:3e:f6:b6:fe"/>
Aug 27 05:30:44 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:30:44 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:30:44 user nova-compute[72904]:       <target dev="tape71f5f4b-a0"/>
Aug 27 05:30:44 user nova-compute[72904]:     </interface>
Aug 27 05:30:44 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:30:44 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/dfce3951-bee5-463e-ac61-031da58e4557/console.log" append="off"/>
Aug 27 05:30:44 user nova-compute[72904]:     </serial>
Aug 27 05:30:44 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:30:44 user nova-compute[72904]:     <video>
Aug 27 05:30:44 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:30:44 user nova-compute[72904]:     </video>
Aug 27 05:30:44 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:30:44 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:30:44 user nova-compute[72904]:     </rng>
Aug 27 05:30:44 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:30:44 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:30:44 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:30:44 user nova-compute[72904]:     </memballoon>
Aug 27 05:30:44 user nova-compute[72904]:   </devices>
Aug 27 05:30:44 user nova-compute[72904]: </domain>
Aug 27 05:30:44 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-439146878',display_name='tempest-TestVolumeBootPattern-volume-backed-server-439146878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-439146878',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCC6Qa31FvKYC+/leStcBJGws1n2FNiuOmRF4iHS54D4UiprTzV5am1rljhH9xs4CE6kTgDBtE7XzR6gsQz3sxh84AdXKMMjKpSCXdmag0e8kPe2a5DSl5neo3SxBM5TQ==',key_name='tempest-keypair-1693054271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-01l637fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=dfce3951-bee5-463e-ac61-031da58e4557,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b6:fe,bridge_name='br-int',has_traffic_filtering=True,id=e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71f5f4b-a0') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG os_vif [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b6:fe,bridge_name='br-int',has_traffic_filtering=True,id=e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71f5f4b-a0') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape71f5f4b-a0, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape71f5f4b-a0, col_values=(('external_ids', {'iface-id': 'e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:b6:fe', 'vm-uuid': 'dfce3951-bee5-463e-ac61-031da58e4557'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:44 user nova-compute[72904]: INFO os_vif [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:b6:fe,bridge_name='br-int',has_traffic_filtering=True,id=e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71f5f4b-a0')
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:30:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No VIF found with MAC fa:16:3e:f6:b6:fe, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-c7f297ed-361d-46d7-a396-51477206f49c req-f65ece2f-ccb5-4db8-befd-08d45693f0a7 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c7f297ed-361d-46d7-a396-51477206f49c req-f65ece2f-ccb5-4db8-befd-08d45693f0a7 service nova] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c7f297ed-361d-46d7-a396-51477206f49c req-f65ece2f-ccb5-4db8-befd-08d45693f0a7 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c7f297ed-361d-46d7-a396-51477206f49c req-f65ece2f-ccb5-4db8-befd-08d45693f0a7 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-c7f297ed-361d-46d7-a396-51477206f49c req-f65ece2f-ccb5-4db8-befd-08d45693f0a7 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] No waiting events found dispatching network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:30:45 user nova-compute[72904]: WARNING nova.compute.manager [req-c7f297ed-361d-46d7-a396-51477206f49c req-f65ece2f-ccb5-4db8-befd-08d45693f0a7 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received unexpected event network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 for instance with vm_state building and task_state spawning.
Aug 27 05:30:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114247.3945448, dfce3951-bee5-463e-ac61-031da58e4557 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:30:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] VM Resumed (Lifecycle Event)
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:30:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Instance spawned successfully.
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:30:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114247.3961408, dfce3951-bee5-463e-ac61-031da58e4557 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:30:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] VM Started (Lifecycle Event)
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:30:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:30:47 user nova-compute[72904]: INFO nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Took 4.82 seconds to spawn the instance on the hypervisor.
Aug 27 05:30:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:30:47 user nova-compute[72904]: INFO nova.compute.manager [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Took 16.46 seconds to build instance.
Aug 27 05:30:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-0be415b1-b93a-41e0-8447-990d9e0124c9 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "dfce3951-bee5-463e-ac61-031da58e4557" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.548s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-50da8177-4bc2-4a79-962c-9c3c7d349355 req-0fce4125-a3db-451e-9ec2-6cb6fd000640 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-50da8177-4bc2-4a79-962c-9c3c7d349355 req-0fce4125-a3db-451e-9ec2-6cb6fd000640 service nova] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-50da8177-4bc2-4a79-962c-9c3c7d349355 req-0fce4125-a3db-451e-9ec2-6cb6fd000640 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-50da8177-4bc2-4a79-962c-9c3c7d349355 req-0fce4125-a3db-451e-9ec2-6cb6fd000640 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-50da8177-4bc2-4a79-962c-9c3c7d349355 req-0fce4125-a3db-451e-9ec2-6cb6fd000640 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] No waiting events found dispatching network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:30:48 user nova-compute[72904]: WARNING nova.compute.manager [req-50da8177-4bc2-4a79-962c-9c3c7d349355 req-0fce4125-a3db-451e-9ec2-6cb6fd000640 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received unexpected event network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 for instance with vm_state active and task_state None.
Aug 27 05:30:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:51 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:30:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:53 user nova-compute[72904]: INFO nova.compute.manager [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Terminating instance
Aug 27 05:30:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-26f4b191-0293-4ba0-ae2d-ac7be3949e2c req-a4c8c83d-4cbc-449c-aaf0-b124381dff7f service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-unplugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-26f4b191-0293-4ba0-ae2d-ac7be3949e2c req-a4c8c83d-4cbc-449c-aaf0-b124381dff7f service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-26f4b191-0293-4ba0-ae2d-ac7be3949e2c req-a4c8c83d-4cbc-449c-aaf0-b124381dff7f service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-26f4b191-0293-4ba0-ae2d-ac7be3949e2c req-a4c8c83d-4cbc-449c-aaf0-b124381dff7f service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-26f4b191-0293-4ba0-ae2d-ac7be3949e2c req-a4c8c83d-4cbc-449c-aaf0-b124381dff7f service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No waiting events found dispatching network-vif-unplugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.compute.manager [req-26f4b191-0293-4ba0-ae2d-ac7be3949e2c req-a4c8c83d-4cbc-449c-aaf0-b124381dff7f service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-unplugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:54 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Instance destroyed successfully.
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.objects.instance [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lazy-loading 'resources' on Instance uuid 0d885076-587e-42ff-b0e4-295860b5bc75 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-27T05:27:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1756367419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-363355423',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB41jIEta1Wjr2W1L1neBnORvuhB9kUCKDt9im7ZtangeVumN2WkX6YS0ZpXTz198bq+o7nF+6Zi+WqUKUkU2zWvq2qzOcw+O5CJIsb7yGjixKzc9Qee4rwCkUirc9/o9A==',key_name='tempest-keypair-1288777666',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:29:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aad2ad0b23fa4d94a54465cf73502f0e',ramdisk_id='',reservation_id='r-1opq4zxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-168812509',owner_user_name='tempest-ServerActionsV293TestJSON-168812509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:29:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c0f942b9b2c4fb58c83f0f5b8edc69e',uuid=0d885076-587e-42ff-b0e4-295860b5bc75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converting VIF {"id": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "address": "fa:16:3e:e0:a8:c8", "network": {"id": "02724cbb-850b-441a-ac21-246bed3ed74e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-939511675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aad2ad0b23fa4d94a54465cf73502f0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007384cf-88", "ovs_interfaceid": "007384cf-88fd-4e73-9c0d-5d8d217060cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_vif [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007384cf-88, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:30:54 user nova-compute[72904]: INFO os_vif [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:a8:c8,bridge_name='br-int',has_traffic_filtering=True,id=007384cf-88fd-4e73-9c0d-5d8d217060cd,network=Network(02724cbb-850b-441a-ac21-246bed3ed74e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007384cf-88')
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PFpEOZQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:30:54 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dcd4bd-e242-412e-bef7-801a520eaeb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Skipping network cache update for instance because it is being deleted. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed79458-ca2d-428f-941f-853d1432317d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:30:54 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:30:54 user nova-compute[72904]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:30:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:30:54 user nova-compute[72904]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e (non-flash)
Aug 27 05:30:54 user nova-compute[72904]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:30:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7cf1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc61c3bc-0239-4165-8dbc-6368c96681a7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a231a-f8ec-4675-bfe7-535a7fb27258]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[162058ef-06ba-4272-8116-8004cde4094b]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cfccd0-89be-4e3c-a23f-4a32323e4884]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1ac745-7d85-43fc-85c0-e27ae99d3d56]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5b0975-6981-416b-85fa-6272d6d8c21b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260]
Aug 27 05:30:54 user nova-compute[72904]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e, portal: 172.16.0.220,3260] successful.
Aug 27 05:30:54 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53a8e5f7-7bf8-4d55-9aea-5106b4130a3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfbff42-051b-4c39-b469-1d522cbc41d6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] <== disconnect_volume: return (308ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:30:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:30:54 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Deleting instance files /opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75_del
Aug 27 05:30:54 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Deletion of /opt/stack/data/nova/instances/0d885076-587e-42ff-b0e4-295860b5bc75_del complete
Aug 27 05:30:55 user nova-compute[72904]: INFO nova.compute.manager [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 27 05:30:55 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:30:55 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:30:55 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:30:55 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating instance_info_cache with network_info: [{"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:30:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-bc93c9f1-59c7-4c48-9677-c74173f3c122" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:30:55 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:30:56 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:30:56 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Took 1.08 seconds to deallocate network for instance.
Aug 27 05:30:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-8962a948-9d40-431c-92ee-70265f5a25e9 req-32683ff3-212b-4b80-a87a-f3097ee07145 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-deleted-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:56 user nova-compute[72904]: INFO nova.compute.manager [req-8962a948-9d40-431c-92ee-70265f5a25e9 req-32683ff3-212b-4b80-a87a-f3097ee07145 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Neutron deleted interface 007384cf-88fd-4e73-9c0d-5d8d217060cd; detaching it from the instance and deleting it from the info cache
Aug 27 05:30:56 user nova-compute[72904]: DEBUG nova.network.neutron [req-8962a948-9d40-431c-92ee-70265f5a25e9 req-32683ff3-212b-4b80-a87a-f3097ee07145 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:30:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-8962a948-9d40-431c-92ee-70265f5a25e9 req-32683ff3-212b-4b80-a87a-f3097ee07145 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Detach interface failed, port_id=007384cf-88fd-4e73-9c0d-5d8d217060cd, reason: Instance 0d885076-587e-42ff-b0e4-295860b5bc75 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:30:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-992fcb1a-fdb1-436f-b480-00ee0ba3abc4 req-b4ab73e6-1453-4b5c-838b-70aa6a2a4664 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:30:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-992fcb1a-fdb1-436f-b480-00ee0ba3abc4 req-b4ab73e6-1453-4b5c-838b-70aa6a2a4664 service nova] Acquiring lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-992fcb1a-fdb1-436f-b480-00ee0ba3abc4 req-b4ab73e6-1453-4b5c-838b-70aa6a2a4664 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-992fcb1a-fdb1-436f-b480-00ee0ba3abc4 req-b4ab73e6-1453-4b5c-838b-70aa6a2a4664 service nova] Lock "0d885076-587e-42ff-b0e4-295860b5bc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:56 user nova-compute[72904]: DEBUG nova.compute.manager [req-992fcb1a-fdb1-436f-b480-00ee0ba3abc4 req-b4ab73e6-1453-4b5c-838b-70aa6a2a4664 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] No waiting events found dispatching network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:30:56 user nova-compute[72904]: WARNING nova.compute.manager [req-992fcb1a-fdb1-436f-b480-00ee0ba3abc4 req-b4ab73e6-1453-4b5c-838b-70aa6a2a4664 service nova] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Received unexpected event network-vif-plugged-007384cf-88fd-4e73-9c0d-5d8d217060cd for instance with vm_state active and task_state deleting.
Aug 27 05:30:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:30:56 user nova-compute[72904]: INFO nova.compute.manager [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Took 0.84 seconds to detach 1 volumes for instance.
Aug 27 05:30:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Deleting volume: 53a8e5f7-7bf8-4d55-9aea-5106b4130a3e {{(pid=72904) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 05:30:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:30:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:30:57 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:30:57 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:30:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:57 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Deleted allocations for instance 0d885076-587e-42ff-b0e4-295860b5bc75
Aug 27 05:30:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-6e5cb5b4-5b14-4476-921f-16b28f7805a6 tempest-ServerActionsV293TestJSON-168812509 tempest-ServerActionsV293TestJSON-168812509-project-member] Lock "0d885076-587e-42ff-b0e4-295860b5bc75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.593s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:30:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:30:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:09 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114254.5977538, 0d885076-587e-42ff-b0e4-295860b5bc75 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:31:09 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] VM Stopped (Lifecycle Event)
Aug 27 05:31:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-538a9285-f289-4547-a343-2311e5e0551f None None] [instance: 0d885076-587e-42ff-b0e4-295860b5bc75] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:31:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:31:15 user nova-compute[72904]: INFO nova.compute.manager [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Detaching volume bbe5a23a-7deb-40fa-b246-4aec498aef38
Aug 27 05:31:15 user nova-compute[72904]: INFO nova.virt.block_device [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Attempting to driver detach volume bbe5a23a-7deb-40fa-b246-4aec498aef38 from mountpoint /dev/vdb
Aug 27 05:31:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Attempting to detach device vdb from instance bc93c9f1-59c7-4c48-9677-c74173f3c122 from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:31:15 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:31:15 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:31:15 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:31:15 user nova-compute[72904]:   <serial>bbe5a23a-7deb-40fa-b246-4aec498aef38</serial>
Aug 27 05:31:15 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:31:15 user nova-compute[72904]: </disk>
Aug 27 05:31:15 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:31:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully detached device vdb from instance bc93c9f1-59c7-4c48-9677-c74173f3c122 from the persistent domain config.
Aug 27 05:31:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc93c9f1-59c7-4c48-9677-c74173f3c122 from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:31:15 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:31:15 user nova-compute[72904]:   <source dev="/dev/sdd"/>
Aug 27 05:31:15 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:31:15 user nova-compute[72904]:   <serial>bbe5a23a-7deb-40fa-b246-4aec498aef38</serial>
Aug 27 05:31:15 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:31:15 user nova-compute[72904]: </disk>
Aug 27 05:31:15 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693114275.7399178, bc93c9f1-59c7-4c48-9677-c74173f3c122 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:31:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully detached device vdb from instance bc93c9f1-59c7-4c48-9677-c74173f3c122 from the live domain config.
Aug 27 05:31:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sjoBTQFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:31:15 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c3933f-0e0e-4343-a17a-5914839407e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[039fe4af-2d82-4900-ac78-2dcd286f8a51]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:31:15 user nova-compute[72904]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:31:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 (non-flash)
Aug 27 05:31:15 user nova-compute[72904]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:31:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c638d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38'): ({'sdd'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Removing single pathed devices sdd {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f2c2af-ec25-47fd-9251-78caf42530f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[990d321b-a75f-42b2-ab83-d178471b799a]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flushing IO for device /dev/sdd {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31a9736-00eb-40fb-b475-330b98b8fcfd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[be539716-2b2e-49bd-8623-bf562a59d94c]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] SCSI volumes sdd have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[857610b0-e363-487c-8b0a-0cace401a6f6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a84569-1ea2-40e6-8bc6-8a8a94456dee]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260]
Aug 27 05:31:15 user nova-compute[72904]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38, portal: 172.16.0.220,3260] successful.
Aug 27 05:31:15 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:31:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbe5a23a-7deb-40fa-b246-4aec498aef38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa2018-8896-4f0e-ab62-85d7a6b65492]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:31:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:31:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:31:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== disconnect_volume: return (253ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:31:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:31:16 user nova-compute[72904]: DEBUG nova.objects.instance [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:31:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-b22ecc64-2d7d-48c0-a60c-45d2fb44262d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.787s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:31:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:31:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:31:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:31:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:31:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:40 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:31:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:31:41 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8581MB free_disk=25.386783599853516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance bc93c9f1-59c7-4c48-9677-c74173f3c122 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance dfce3951-bee5-463e-ac61-031da58e4557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:31:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:31:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:51 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:31:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:31:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:31:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:31:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:31:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:31:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:31:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:31:56 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:31:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:57 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating instance_info_cache with network_info: [{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:31:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:31:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:31:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:31:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:31:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:05 user nova-compute[72904]: INFO nova.compute.manager [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Terminating instance
Aug 27 05:32:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-6442b30e-3a8d-4b8a-a764-de0275241187 req-047aa9fa-5b18-48ed-aff7-9ae6f826af20 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-vif-unplugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6442b30e-3a8d-4b8a-a764-de0275241187 req-047aa9fa-5b18-48ed-aff7-9ae6f826af20 service nova] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6442b30e-3a8d-4b8a-a764-de0275241187 req-047aa9fa-5b18-48ed-aff7-9ae6f826af20 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6442b30e-3a8d-4b8a-a764-de0275241187 req-047aa9fa-5b18-48ed-aff7-9ae6f826af20 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-6442b30e-3a8d-4b8a-a764-de0275241187 req-047aa9fa-5b18-48ed-aff7-9ae6f826af20 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] No waiting events found dispatching network-vif-unplugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-6442b30e-3a8d-4b8a-a764-de0275241187 req-047aa9fa-5b18-48ed-aff7-9ae6f826af20 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-vif-unplugged-f944dce2-6850-477e-a789-7561f8a90c01 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:32:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Instance destroyed successfully.
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'resources' on Instance uuid bc93c9f1-59c7-4c48-9677-c74173f3c122 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1382889880',display_name='tempest-AttachVolumeNegativeTest-server-1382889880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1382889880',id=39,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkQMZBU5tAJhz5Q7Mohk7c/mqQDWjPm1pP1Eimsjp4Nz65OVWHnlPYbA47pxXNIW76FpOqhrJqLJYnUW3F9RlMecNHOB6tQWknEtFcntDjkB408TediwEcdwx5NcCZz5Q==',key_name='tempest-keypair-661803103',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:26:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-3ukawj1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:26:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=bc93c9f1-59c7-4c48-9677-c74173f3c122,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "f944dce2-6850-477e-a789-7561f8a90c01", "address": "fa:16:3e:4a:6f:e8", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf944dce2-68", "ovs_interfaceid": "f944dce2-6850-477e-a789-7561f8a90c01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6f:e8,bridge_name='br-int',has_traffic_filtering=True,id=f944dce2-6850-477e-a789-7561f8a90c01,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf944dce2-68') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG os_vif [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6f:e8,bridge_name='br-int',has_traffic_filtering=True,id=f944dce2-6850-477e-a789-7561f8a90c01,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf944dce2-68') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf944dce2-68, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:32:06 user nova-compute[72904]: INFO os_vif [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:6f:e8,bridge_name='br-int',has_traffic_filtering=True,id=f944dce2-6850-477e-a789-7561f8a90c01,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf944dce2-68')
Aug 27 05:32:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Deleting instance files /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122_del
Aug 27 05:32:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Deletion of /opt/stack/data/nova/instances/bc93c9f1-59c7-4c48-9677-c74173f3c122_del complete
Aug 27 05:32:06 user nova-compute[72904]: INFO nova.compute.manager [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:06 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:32:06 user nova-compute[72904]: INFO nova.compute.claims [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Claim successful on node user
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.network.neutron [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:32:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:32:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Creating image(s)
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "/opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "/opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.policy [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '928d869d131242558ef28f435579a622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c477fdf6d3c8445e92cb51ca9f3033c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.171s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk 1073741824" returned: 0 in 0.049s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:32:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-7670eb3d-bc75-4a12-a49a-fdef38599e1d req-66b4dc6e-ccdb-428f-972a-ff6a2a4d51c2 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7670eb3d-bc75-4a12-a49a-fdef38599e1d req-66b4dc6e-ccdb-428f-972a-ff6a2a4d51c2 service nova] Acquiring lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7670eb3d-bc75-4a12-a49a-fdef38599e1d req-66b4dc6e-ccdb-428f-972a-ff6a2a4d51c2 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7670eb3d-bc75-4a12-a49a-fdef38599e1d req-66b4dc6e-ccdb-428f-972a-ff6a2a4d51c2 service nova] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-7670eb3d-bc75-4a12-a49a-fdef38599e1d req-66b4dc6e-ccdb-428f-972a-ff6a2a4d51c2 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] No waiting events found dispatching network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:32:08 user nova-compute[72904]: WARNING nova.compute.manager [req-7670eb3d-bc75-4a12-a49a-fdef38599e1d req-66b4dc6e-ccdb-428f-972a-ff6a2a4d51c2 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received unexpected event network-vif-plugged-f944dce2-6850-477e-a789-7561f8a90c01 for instance with vm_state active and task_state deleting.
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Cannot resize image /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Ensure instance console log exists: /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-0454702b-e03b-4b7a-9499-1cd34c6c9e44 req-10768cd0-4b2e-402c-8ae1-3b1e95c78965 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Received event network-vif-deleted-f944dce2-6850-477e-a789-7561f8a90c01 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:08 user nova-compute[72904]: INFO nova.compute.manager [req-0454702b-e03b-4b7a-9499-1cd34c6c9e44 req-10768cd0-4b2e-402c-8ae1-3b1e95c78965 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Neutron deleted interface f944dce2-6850-477e-a789-7561f8a90c01; detaching it from the instance and deleting it from the info cache
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.network.neutron [req-0454702b-e03b-4b7a-9499-1cd34c6c9e44 req-10768cd0-4b2e-402c-8ae1-3b1e95c78965 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:08 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Took 1.51 seconds to deallocate network for instance.
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-0454702b-e03b-4b7a-9499-1cd34c6c9e44 req-10768cd0-4b2e-402c-8ae1-3b1e95c78965 service nova] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Detach interface failed, port_id=f944dce2-6850-477e-a789-7561f8a90c01, reason: Instance bc93c9f1-59c7-4c48-9677-c74173f3c122 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:08 user nova-compute[72904]: DEBUG nova.network.neutron [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Successfully created port: 844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:32:08 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Deleted allocations for instance bc93c9f1-59c7-4c48-9677-c74173f3c122
Aug 27 05:32:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a7f09e68-fa92-455a-9fc4-340b5575f4ca tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "bc93c9f1-59c7-4c48-9677-c74173f3c122" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.788s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Successfully updated port: 844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquired lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Updating instance_info_cache with network_info: [{"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Releasing lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Instance network_info: |[{"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Start _get_guest_xml network_info=[{"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:32:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:32:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1693157828',display_name='tempest-VolumesActionsTest-instance-1693157828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1693157828',id=44,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c477fdf6d3c8445e92cb51ca9f3033c0',ramdisk_id='',reservation_id='r-1330sms0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1996509569',owner_user_name='tempest-VolumesActionsTest-1996509569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:32:07Z,user_data=None,user_id='928d869d131242558ef28f435579a622',uuid=a5c5c054-1640-4c8d-9379-e732e0f2ae8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Converting VIF {"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:cd:d3,bridge_name='br-int',has_traffic_filtering=True,id=844adc6e-5862-4163-af44-3c0a463594fa,network=Network(c8fb9754-1bed-44c2-b0fe-47effa011932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844adc6e-58') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.objects.instance [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lazy-loading 'pci_devices' on Instance uuid a5c5c054-1640-4c8d-9379-e732e0f2ae8e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:32:09 user nova-compute[72904]:   <uuid>a5c5c054-1640-4c8d-9379-e732e0f2ae8e</uuid>
Aug 27 05:32:09 user nova-compute[72904]:   <name>instance-0000002c</name>
Aug 27 05:32:09 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:32:09 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:32:09 user nova-compute[72904]:   <metadata>
Aug 27 05:32:09 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:32:09 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:32:09 user nova-compute[72904]:       <nova:name>tempest-VolumesActionsTest-instance-1693157828</nova:name>
Aug 27 05:32:09 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:32:09</nova:creationTime>
Aug 27 05:32:09 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:32:09 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:32:09 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:32:09 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:32:09 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:32:09 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:32:09 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:32:09 user nova-compute[72904]:       <nova:owner>
Aug 27 05:32:09 user nova-compute[72904]:         <nova:user uuid="928d869d131242558ef28f435579a622">tempest-VolumesActionsTest-1996509569-project-member</nova:user>
Aug 27 05:32:09 user nova-compute[72904]:         <nova:project uuid="c477fdf6d3c8445e92cb51ca9f3033c0">tempest-VolumesActionsTest-1996509569</nova:project>
Aug 27 05:32:09 user nova-compute[72904]:       </nova:owner>
Aug 27 05:32:09 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:32:09 user nova-compute[72904]:       <nova:ports>
Aug 27 05:32:09 user nova-compute[72904]:         <nova:port uuid="844adc6e-5862-4163-af44-3c0a463594fa">
Aug 27 05:32:09 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 27 05:32:09 user nova-compute[72904]:         </nova:port>
Aug 27 05:32:09 user nova-compute[72904]:       </nova:ports>
Aug 27 05:32:09 user nova-compute[72904]:     </nova:instance>
Aug 27 05:32:09 user nova-compute[72904]:   </metadata>
Aug 27 05:32:09 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:32:09 user nova-compute[72904]:     <system>
Aug 27 05:32:09 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:32:09 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:32:09 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:32:09 user nova-compute[72904]:       <entry name="serial">a5c5c054-1640-4c8d-9379-e732e0f2ae8e</entry>
Aug 27 05:32:09 user nova-compute[72904]:       <entry name="uuid">a5c5c054-1640-4c8d-9379-e732e0f2ae8e</entry>
Aug 27 05:32:09 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:32:09 user nova-compute[72904]:     </system>
Aug 27 05:32:09 user nova-compute[72904]:   </sysinfo>
Aug 27 05:32:09 user nova-compute[72904]:   <os>
Aug 27 05:32:09 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:32:09 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:32:09 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:32:09 user nova-compute[72904]:   </os>
Aug 27 05:32:09 user nova-compute[72904]:   <features>
Aug 27 05:32:09 user nova-compute[72904]:     <acpi/>
Aug 27 05:32:09 user nova-compute[72904]:     <apic/>
Aug 27 05:32:09 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:32:09 user nova-compute[72904]:   </features>
Aug 27 05:32:09 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:32:09 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:32:09 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:32:09 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:32:09 user nova-compute[72904]:   </clock>
Aug 27 05:32:09 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:32:09 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:32:09 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:32:09 user nova-compute[72904]:   </cpu>
Aug 27 05:32:09 user nova-compute[72904]:   <devices>
Aug 27 05:32:09 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:32:09 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:32:09 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk"/>
Aug 27 05:32:09 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:32:09 user nova-compute[72904]:     </disk>
Aug 27 05:32:09 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:32:09 user nova-compute[72904]:       <mac address="fa:16:3e:07:cd:d3"/>
Aug 27 05:32:09 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:32:09 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:32:09 user nova-compute[72904]:       <target dev="tap844adc6e-58"/>
Aug 27 05:32:09 user nova-compute[72904]:     </interface>
Aug 27 05:32:09 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:32:09 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/console.log" append="off"/>
Aug 27 05:32:09 user nova-compute[72904]:     </serial>
Aug 27 05:32:09 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:32:09 user nova-compute[72904]:     <video>
Aug 27 05:32:09 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:32:09 user nova-compute[72904]:     </video>
Aug 27 05:32:09 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:32:09 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:32:09 user nova-compute[72904]:     </rng>
Aug 27 05:32:09 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:32:09 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:32:09 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:32:09 user nova-compute[72904]:     </memballoon>
Aug 27 05:32:09 user nova-compute[72904]:   </devices>
Aug 27 05:32:09 user nova-compute[72904]: </domain>
Aug 27 05:32:09 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1693157828',display_name='tempest-VolumesActionsTest-instance-1693157828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1693157828',id=44,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c477fdf6d3c8445e92cb51ca9f3033c0',ramdisk_id='',reservation_id='r-1330sms0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1996509569',owner_user_name='tempest-VolumesActionsTest-1996509569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:32:07Z,user_data=None,user_id='928d869d131242558ef28f435579a622',uuid=a5c5c054-1640-4c8d-9379-e732e0f2ae8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Converting VIF {"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:cd:d3,bridge_name='br-int',has_traffic_filtering=True,id=844adc6e-5862-4163-af44-3c0a463594fa,network=Network(c8fb9754-1bed-44c2-b0fe-47effa011932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844adc6e-58') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG os_vif [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:cd:d3,bridge_name='br-int',has_traffic_filtering=True,id=844adc6e-5862-4163-af44-3c0a463594fa,network=Network(c8fb9754-1bed-44c2-b0fe-47effa011932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844adc6e-58') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap844adc6e-58, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap844adc6e-58, col_values=(('external_ids', {'iface-id': '844adc6e-5862-4163-af44-3c0a463594fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:cd:d3', 'vm-uuid': 'a5c5c054-1640-4c8d-9379-e732e0f2ae8e'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:09 user nova-compute[72904]: INFO os_vif [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:cd:d3,bridge_name='br-int',has_traffic_filtering=True,id=844adc6e-5862-4163-af44-3c0a463594fa,network=Network(c8fb9754-1bed-44c2-b0fe-47effa011932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844adc6e-58')
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:32:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] No VIF found with MAC fa:16:3e:07:cd:d3, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received event network-changed-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Refreshing instance network info cache due to event network-changed-844adc6e-5862-4163-af44-3c0a463594fa. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] Acquiring lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] Acquired lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Refreshing network info cache for port 844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Updated VIF entry in instance network info cache for port 844adc6e-5862-4163-af44-3c0a463594fa. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG nova.network.neutron [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Updating instance_info_cache with network_info: [{"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-911ea8e8-0bf3-495c-89a7-17e3d6711e49 req-017d10ec-1026-4df5-9fe9-988e8c9648b5 service nova] Releasing lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received event network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] Acquiring lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] No waiting events found dispatching network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:32:12 user nova-compute[72904]: WARNING nova.compute.manager [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received unexpected event network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa for instance with vm_state building and task_state spawning.
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received event network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] Acquiring lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] No waiting events found dispatching network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:32:12 user nova-compute[72904]: WARNING nova.compute.manager [req-548700ca-fb27-44ab-9137-c85e286f3970 req-3cde778a-bea5-4557-9736-0c0f74b14e6f service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received unexpected event network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa for instance with vm_state building and task_state spawning.
Aug 27 05:32:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114332.9792504, a5c5c054-1640-4c8d-9379-e732e0f2ae8e => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:32:12 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] VM Resumed (Lifecycle Event)
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:32:12 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Instance spawned successfully.
Aug 27 05:32:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:13 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114332.9804804, a5c5c054-1640-4c8d-9379-e732e0f2ae8e => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:32:13 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] VM Started (Lifecycle Event)
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:32:13 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:32:13 user nova-compute[72904]: INFO nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 27 05:32:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:32:13 user nova-compute[72904]: INFO nova.compute.manager [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Took 6.37 seconds to build instance.
Aug 27 05:32:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-578449eb-fe82-4eae-a888-98c3779a85d1 tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.545s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:21 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114326.5428543, bc93c9f1-59c7-4c48-9677-c74173f3c122 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:32:21 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] VM Stopped (Lifecycle Event)
Aug 27 05:32:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e05b2e9d-77f2-4aa8-9963-488175197dd9 None None] [instance: bc93c9f1-59c7-4c48-9677-c74173f3c122] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:32:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-changed-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:22 user nova-compute[72904]: DEBUG nova.compute.manager [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Refreshing instance network info cache due to event network-changed-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:32:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] Acquiring lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:32:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] Acquired lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:32:22 user nova-compute[72904]: DEBUG nova.network.neutron [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Refreshing network info cache for port e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:32:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updated VIF entry in instance network info cache for port e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:32:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating instance_info_cache with network_info: [{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f7ae3a60-5017-46c1-9fa1-054a78338393 req-23721bbd-62a1-4159-9277-cdbbd8d46033 service nova] Releasing lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:32:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:32:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:32:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:32:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:32:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "398aca08-15ea-487c-a012-a9a75b705b97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "398aca08-15ea-487c-a012-a9a75b705b97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:32:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:35 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:32:35 user nova-compute[72904]: INFO nova.compute.claims [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Claim successful on node user
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:32:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:32:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:32:36 user nova-compute[72904]: INFO nova.virt.block_device [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Booting with volume snapshot 8a1f1f60-8a50-455d-835a-07203b0f6f7c at /dev/vda
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.policy [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fd6f1e0a2843cca915e52045b78d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41729cc06fa94b569a46e971b769d96f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:32:36 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Successfully created port: 13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Successfully updated port: 13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquired lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-changed-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Refreshing instance network info cache due to event network-changed-13b96b34-542d-4da2-a2f9-0deb0116a2ad. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] Acquiring lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updating instance_info_cache with network_info: [{"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:37 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Releasing lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:32:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Instance network_info: |[{"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:32:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] Acquired lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:32:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Refreshing network info cache for port 13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:32:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updated VIF entry in instance network info cache for port 13b96b34-542d-4da2-a2f9-0deb0116a2ad. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:32:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updating instance_info_cache with network_info: [{"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f503ead7-5347-4dce-90ea-7d20ba6343ac req-df6382c9-cfac-41e0-ba1b-6b5d4deb7477 service nova] Releasing lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:32:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG os_brick.utils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0e2188-296d-4571-8f31-8a617c17abd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d5fdc8-deb6-4158-9a6a-1218f3762abc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a617dfe-c408-437f-989b-474896f03c2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e665257-b4aa-4a89-98fc-cbad052571c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:32:42 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7268dc8b-7aa8-40b6-822f-5f78a0e3c126]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG os_brick.utils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updating existing volume attachment record: cf47de7e-d05c-47a3-ab87-811452028a72 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:32:43 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:32:43 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8509MB free_disk=25.375396728515625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance dfce3951-bee5-463e-ac61-031da58e4557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance a5c5c054-1640-4c8d-9379-e732e0f2ae8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 398aca08-15ea-487c-a012-a9a75b705b97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:32:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:32:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Creating image(s)
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Ensure instance console log exists: /opt/stack/data/nova/instances/398aca08-15ea-487c-a012-a9a75b705b97/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Start _get_guest_xml network_info=[{"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T05:32:24Z,direct_url=<?>,disk_format='qcow2',id=f27bb442-d526-45c4-bb7d-830084f9191d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2120680310',owner='41729cc06fa94b569a46e971b769d96f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T05:32:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cf47de7e-d05c-47a3-ab87-811452028a72', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHvIpCLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '398aca08-15ea-487c-a012-a9a75b705b97', 'attached_at': '', 'detached_at': '', 'volume_id': '9c3321af-3d45-41b8-bb13-c2484f4a3761', 'serial': '9c3321af-3d45-41b8-bb13-c2484f4a3761'}, 'device_type': 'disk', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:32:52 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:32:52 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-27T05:32:24Z,direct_url=<?>,disk_format='qcow2',id=f27bb442-d526-45c4-bb7d-830084f9191d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2120680310',owner='41729cc06fa94b569a46e971b769d96f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-27T05:32:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHvIpCLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:32:52 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:32:52 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:32:52 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809e755-f6ce-4d76-94ac-01984cde512c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:32:52 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb4e226-fd98-4ad6-9329-5959c02d65bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761] added
Aug 27 05:32:52 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[817b02d2-93be-46ae-9242-01c79a4c5baf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5652eed5-b0b6-4ec2-9b82-ef73d7059c74]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wHvIpCLX {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wHvIpCLX" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e37a1c-6dd4-4768-90ff-ef1574660edd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wHvIpCLX'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[51284e74-8675-4e98-b32d-6fceb4df11c9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e56439-2341-42ab-b5cf-25e92146ac96]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:32:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:32:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8752be3-4f65-45b2-8c95-e2ed63c4ce1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260]
Aug 27 05:32:53 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260] successful.
Aug 27 05:32:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1c26b-5d36-4c70-bab4-fbe15cef1013]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba43c0-66a6-4647-a35b-869a0dbbb08d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:32:53 user nova-compute[72904]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 (non-flash)
Aug 27 05:32:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:32:53 user nova-compute[72904]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 (non-flash)
Aug 27 05:32:53 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd69143-839b-4254-a378-37c62f635f7c]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHvIpCLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26635376164636432', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635376164636432', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1710060912',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1710060912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1710060912',id=45,image_ref='f27bb442-d526-45c4-bb7d-830084f9191d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJBT6eFjnPJR3P+MSyNksrmGUAaReAGSGwiVPPMfqpWAaIVlUcmSdmhfw5pvY/Gv2wbij89NsixagawE27m+c4INFuDXadLufF3GJNWG+zneuTgve6gaqVAAwi0H+Q2Kw==',key_name='tempest-keypair-1069314164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-690s7nx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1154964358',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=398aca08-15ea-487c-a012-a9a75b705b97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=13b96b34-542d-4da2-a2f9-0deb0116a2ad,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b96b34-54') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'pci_devices' on Instance uuid 398aca08-15ea-487c-a012-a9a75b705b97 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:32:54 user nova-compute[72904]:   <uuid>398aca08-15ea-487c-a012-a9a75b705b97</uuid>
Aug 27 05:32:54 user nova-compute[72904]:   <name>instance-0000002d</name>
Aug 27 05:32:54 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:32:54 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:32:54 user nova-compute[72904]:   <metadata>
Aug 27 05:32:54 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:32:54 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:32:54 user nova-compute[72904]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1710060912</nova:name>
Aug 27 05:32:54 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:32:52</nova:creationTime>
Aug 27 05:32:54 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:32:54 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:32:54 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:32:54 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:32:54 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:32:54 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:32:54 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:32:54 user nova-compute[72904]:       <nova:owner>
Aug 27 05:32:54 user nova-compute[72904]:         <nova:user uuid="75fd6f1e0a2843cca915e52045b78d4f">tempest-TestVolumeBootPattern-1154964358-project-member</nova:user>
Aug 27 05:32:54 user nova-compute[72904]:         <nova:project uuid="41729cc06fa94b569a46e971b769d96f">tempest-TestVolumeBootPattern-1154964358</nova:project>
Aug 27 05:32:54 user nova-compute[72904]:       </nova:owner>
Aug 27 05:32:54 user nova-compute[72904]:       <nova:root type="image" uuid="f27bb442-d526-45c4-bb7d-830084f9191d"/>
Aug 27 05:32:54 user nova-compute[72904]:       <nova:ports>
Aug 27 05:32:54 user nova-compute[72904]:         <nova:port uuid="13b96b34-542d-4da2-a2f9-0deb0116a2ad">
Aug 27 05:32:54 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 05:32:54 user nova-compute[72904]:         </nova:port>
Aug 27 05:32:54 user nova-compute[72904]:       </nova:ports>
Aug 27 05:32:54 user nova-compute[72904]:     </nova:instance>
Aug 27 05:32:54 user nova-compute[72904]:   </metadata>
Aug 27 05:32:54 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:32:54 user nova-compute[72904]:     <system>
Aug 27 05:32:54 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:32:54 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:32:54 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:32:54 user nova-compute[72904]:       <entry name="serial">398aca08-15ea-487c-a012-a9a75b705b97</entry>
Aug 27 05:32:54 user nova-compute[72904]:       <entry name="uuid">398aca08-15ea-487c-a012-a9a75b705b97</entry>
Aug 27 05:32:54 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:32:54 user nova-compute[72904]:     </system>
Aug 27 05:32:54 user nova-compute[72904]:   </sysinfo>
Aug 27 05:32:54 user nova-compute[72904]:   <os>
Aug 27 05:32:54 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:32:54 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:32:54 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:32:54 user nova-compute[72904]:   </os>
Aug 27 05:32:54 user nova-compute[72904]:   <features>
Aug 27 05:32:54 user nova-compute[72904]:     <acpi/>
Aug 27 05:32:54 user nova-compute[72904]:     <apic/>
Aug 27 05:32:54 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:32:54 user nova-compute[72904]:   </features>
Aug 27 05:32:54 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:32:54 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:32:54 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:32:54 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:32:54 user nova-compute[72904]:   </clock>
Aug 27 05:32:54 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:32:54 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:32:54 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:32:54 user nova-compute[72904]:   </cpu>
Aug 27 05:32:54 user nova-compute[72904]:   <devices>
Aug 27 05:32:54 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:32:54 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:32:54 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:32:54 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:32:54 user nova-compute[72904]:       <serial>9c3321af-3d45-41b8-bb13-c2484f4a3761</serial>
Aug 27 05:32:54 user nova-compute[72904]:     </disk>
Aug 27 05:32:54 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:32:54 user nova-compute[72904]:       <mac address="fa:16:3e:c7:79:ce"/>
Aug 27 05:32:54 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:32:54 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:32:54 user nova-compute[72904]:       <target dev="tap13b96b34-54"/>
Aug 27 05:32:54 user nova-compute[72904]:     </interface>
Aug 27 05:32:54 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:32:54 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/398aca08-15ea-487c-a012-a9a75b705b97/console.log" append="off"/>
Aug 27 05:32:54 user nova-compute[72904]:     </serial>
Aug 27 05:32:54 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:32:54 user nova-compute[72904]:     <video>
Aug 27 05:32:54 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:32:54 user nova-compute[72904]:     </video>
Aug 27 05:32:54 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:32:54 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:32:54 user nova-compute[72904]:     </rng>
Aug 27 05:32:54 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:32:54 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:32:54 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:32:54 user nova-compute[72904]:     </memballoon>
Aug 27 05:32:54 user nova-compute[72904]:   </devices>
Aug 27 05:32:54 user nova-compute[72904]: </domain>
Aug 27 05:32:54 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1710060912',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1710060912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1710060912',id=45,image_ref='f27bb442-d526-45c4-bb7d-830084f9191d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJBT6eFjnPJR3P+MSyNksrmGUAaReAGSGwiVPPMfqpWAaIVlUcmSdmhfw5pvY/Gv2wbij89NsixagawE27m+c4INFuDXadLufF3GJNWG+zneuTgve6gaqVAAwi0H+Q2Kw==',key_name='tempest-keypair-1069314164',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-690s7nx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1154964358',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:32:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=398aca08-15ea-487c-a012-a9a75b705b97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=13b96b34-542d-4da2-a2f9-0deb0116a2ad,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b96b34-54') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG os_vif [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=13b96b34-542d-4da2-a2f9-0deb0116a2ad,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b96b34-54') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13b96b34-54, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13b96b34-54, col_values=(('external_ids', {'iface-id': '13b96b34-542d-4da2-a2f9-0deb0116a2ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:79:ce', 'vm-uuid': '398aca08-15ea-487c-a012-a9a75b705b97'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:54 user nova-compute[72904]: INFO os_vif [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=13b96b34-542d-4da2-a2f9-0deb0116a2ad,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b96b34-54')
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No VIF found with MAC fa:16:3e:c7:79:ce, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:32:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-1a1f0d50-dab9-4bcc-8be1-e92c046e597e req-31c06b6d-c21a-44dd-b00e-b5b60d795c58 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1a1f0d50-dab9-4bcc-8be1-e92c046e597e req-31c06b6d-c21a-44dd-b00e-b5b60d795c58 service nova] Acquiring lock "398aca08-15ea-487c-a012-a9a75b705b97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1a1f0d50-dab9-4bcc-8be1-e92c046e597e req-31c06b6d-c21a-44dd-b00e-b5b60d795c58 service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1a1f0d50-dab9-4bcc-8be1-e92c046e597e req-31c06b6d-c21a-44dd-b00e-b5b60d795c58 service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:55 user nova-compute[72904]: DEBUG nova.compute.manager [req-1a1f0d50-dab9-4bcc-8be1-e92c046e597e req-31c06b6d-c21a-44dd-b00e-b5b60d795c58 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] No waiting events found dispatching network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:32:55 user nova-compute[72904]: WARNING nova.compute.manager [req-1a1f0d50-dab9-4bcc-8be1-e92c046e597e req-31c06b6d-c21a-44dd-b00e-b5b60d795c58 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received unexpected event network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad for instance with vm_state building and task_state spawning.
Aug 27 05:32:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Skipping network cache update for instance because it is Building. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:32:56 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid dfce3951-bee5-463e-ac61-031da58e4557 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating instance_info_cache with network_info: [{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114377.57406, 398aca08-15ea-487c-a012-a9a75b705b97 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:32:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] VM Resumed (Lifecycle Event)
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:32:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Instance spawned successfully.
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:32:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114377.5751276, 398aca08-15ea-487c-a012-a9a75b705b97 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:32:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] VM Started (Lifecycle Event)
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:32:57 user nova-compute[72904]: INFO nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Took 4.82 seconds to spawn the instance on the hypervisor.
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:32:57 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:32:57 user nova-compute[72904]: INFO nova.compute.manager [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Took 21.96 seconds to build instance.
Aug 27 05:32:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1f3de951-1995-4d74-a8da-c9525b67174d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "398aca08-15ea-487c-a012-a9a75b705b97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.066s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-54b2f49a-077f-4cfb-a61a-a78b8d5439f1 req-2c9e33a4-ece6-426f-b8b0-7bc40fc88d2f service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-54b2f49a-077f-4cfb-a61a-a78b8d5439f1 req-2c9e33a4-ece6-426f-b8b0-7bc40fc88d2f service nova] Acquiring lock "398aca08-15ea-487c-a012-a9a75b705b97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-54b2f49a-077f-4cfb-a61a-a78b8d5439f1 req-2c9e33a4-ece6-426f-b8b0-7bc40fc88d2f service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-54b2f49a-077f-4cfb-a61a-a78b8d5439f1 req-2c9e33a4-ece6-426f-b8b0-7bc40fc88d2f service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:32:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-54b2f49a-077f-4cfb-a61a-a78b8d5439f1 req-2c9e33a4-ece6-426f-b8b0-7bc40fc88d2f service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] No waiting events found dispatching network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:32:57 user nova-compute[72904]: WARNING nova.compute.manager [req-54b2f49a-077f-4cfb-a61a-a78b8d5439f1 req-2c9e33a4-ece6-426f-b8b0-7bc40fc88d2f service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received unexpected event network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad for instance with vm_state active and task_state None.
Aug 27 05:32:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:32:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:32:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:32:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:32:59 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:32:59 user nova-compute[72904]: INFO nova.compute.claims [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Claim successful on node user
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:33:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:33:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Creating image(s)
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG nova.policy [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008a26244e704805b8f77410645a4e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63127190a4ad4846892961f9785fb132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:33:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.242s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk 1073741824" returned: 0 in 0.052s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.193s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Successfully created port: 54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Cannot resize image /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Ensure instance console log exists: /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:33:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Successfully updated port: 54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquired lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-changed-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Refreshing instance network info cache due to event network-changed-54b7a0c2-ceef-4319-88fd-bf06b747ef29. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] Acquiring lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updating instance_info_cache with network_info: [{"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Releasing lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Instance network_info: |[{"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] Acquired lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.neutron [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Refreshing network info cache for port 54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Start _get_guest_xml network_info=[{"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:33:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:33:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924573234',display_name='tempest-AttachVolumeNegativeTest-server-1924573234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1924573234',id=46,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr4cCoGyXTrRxMbo7b1w0HFJ49g4xkaazP6blP3YxhSdd4D85EUxUoa5x3kTMmDEx2II65hVnynillZmMwA+xlgNDPlBJvM1XT5gizIbny/MDzLLryBQa00y7xl291G3Q==',key_name='tempest-keypair-279435540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-n3hsjj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:aa,bridge_name='br-int',has_traffic_filtering=True,id=54b7a0c2-ceef-4319-88fd-bf06b747ef29,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b7a0c2-ce') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:33:02 user nova-compute[72904]:   <uuid>2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec</uuid>
Aug 27 05:33:02 user nova-compute[72904]:   <name>instance-0000002e</name>
Aug 27 05:33:02 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:33:02 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:33:02 user nova-compute[72904]:   <metadata>
Aug 27 05:33:02 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:33:02 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:33:02 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1924573234</nova:name>
Aug 27 05:33:02 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:33:02</nova:creationTime>
Aug 27 05:33:02 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:33:02 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:33:02 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:33:02 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:33:02 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:33:02 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:33:02 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:33:02 user nova-compute[72904]:       <nova:owner>
Aug 27 05:33:02 user nova-compute[72904]:         <nova:user uuid="008a26244e704805b8f77410645a4e7f">tempest-AttachVolumeNegativeTest-159688162-project-member</nova:user>
Aug 27 05:33:02 user nova-compute[72904]:         <nova:project uuid="63127190a4ad4846892961f9785fb132">tempest-AttachVolumeNegativeTest-159688162</nova:project>
Aug 27 05:33:02 user nova-compute[72904]:       </nova:owner>
Aug 27 05:33:02 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:33:02 user nova-compute[72904]:       <nova:ports>
Aug 27 05:33:02 user nova-compute[72904]:         <nova:port uuid="54b7a0c2-ceef-4319-88fd-bf06b747ef29">
Aug 27 05:33:02 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 27 05:33:02 user nova-compute[72904]:         </nova:port>
Aug 27 05:33:02 user nova-compute[72904]:       </nova:ports>
Aug 27 05:33:02 user nova-compute[72904]:     </nova:instance>
Aug 27 05:33:02 user nova-compute[72904]:   </metadata>
Aug 27 05:33:02 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:33:02 user nova-compute[72904]:     <system>
Aug 27 05:33:02 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:33:02 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:33:02 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:33:02 user nova-compute[72904]:       <entry name="serial">2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec</entry>
Aug 27 05:33:02 user nova-compute[72904]:       <entry name="uuid">2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec</entry>
Aug 27 05:33:02 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:33:02 user nova-compute[72904]:     </system>
Aug 27 05:33:02 user nova-compute[72904]:   </sysinfo>
Aug 27 05:33:02 user nova-compute[72904]:   <os>
Aug 27 05:33:02 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:33:02 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:33:02 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:33:02 user nova-compute[72904]:   </os>
Aug 27 05:33:02 user nova-compute[72904]:   <features>
Aug 27 05:33:02 user nova-compute[72904]:     <acpi/>
Aug 27 05:33:02 user nova-compute[72904]:     <apic/>
Aug 27 05:33:02 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:33:02 user nova-compute[72904]:   </features>
Aug 27 05:33:02 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:33:02 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:33:02 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:33:02 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:33:02 user nova-compute[72904]:   </clock>
Aug 27 05:33:02 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:33:02 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:33:02 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:33:02 user nova-compute[72904]:   </cpu>
Aug 27 05:33:02 user nova-compute[72904]:   <devices>
Aug 27 05:33:02 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:33:02 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:33:02 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk"/>
Aug 27 05:33:02 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:33:02 user nova-compute[72904]:     </disk>
Aug 27 05:33:02 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:33:02 user nova-compute[72904]:       <mac address="fa:16:3e:88:48:aa"/>
Aug 27 05:33:02 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:33:02 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:33:02 user nova-compute[72904]:       <target dev="tap54b7a0c2-ce"/>
Aug 27 05:33:02 user nova-compute[72904]:     </interface>
Aug 27 05:33:02 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:33:02 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/console.log" append="off"/>
Aug 27 05:33:02 user nova-compute[72904]:     </serial>
Aug 27 05:33:02 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:33:02 user nova-compute[72904]:     <video>
Aug 27 05:33:02 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:33:02 user nova-compute[72904]:     </video>
Aug 27 05:33:02 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:33:02 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:33:02 user nova-compute[72904]:     </rng>
Aug 27 05:33:02 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:33:02 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:33:02 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:33:02 user nova-compute[72904]:     </memballoon>
Aug 27 05:33:02 user nova-compute[72904]:   </devices>
Aug 27 05:33:02 user nova-compute[72904]: </domain>
Aug 27 05:33:02 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924573234',display_name='tempest-AttachVolumeNegativeTest-server-1924573234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1924573234',id=46,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr4cCoGyXTrRxMbo7b1w0HFJ49g4xkaazP6blP3YxhSdd4D85EUxUoa5x3kTMmDEx2II65hVnynillZmMwA+xlgNDPlBJvM1XT5gizIbny/MDzLLryBQa00y7xl291G3Q==',key_name='tempest-keypair-279435540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-n3hsjj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:33:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:aa,bridge_name='br-int',has_traffic_filtering=True,id=54b7a0c2-ceef-4319-88fd-bf06b747ef29,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b7a0c2-ce') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG os_vif [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:aa,bridge_name='br-int',has_traffic_filtering=True,id=54b7a0c2-ceef-4319-88fd-bf06b747ef29,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b7a0c2-ce') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54b7a0c2-ce, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54b7a0c2-ce, col_values=(('external_ids', {'iface-id': '54b7a0c2-ceef-4319-88fd-bf06b747ef29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:48:aa', 'vm-uuid': '2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:02 user nova-compute[72904]: INFO os_vif [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:48:aa,bridge_name='br-int',has_traffic_filtering=True,id=54b7a0c2-ceef-4319-88fd-bf06b747ef29,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b7a0c2-ce')
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:33:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No VIF found with MAC fa:16:3e:88:48:aa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:33:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updated VIF entry in instance network info cache for port 54b7a0c2-ceef-4319-88fd-bf06b747ef29. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:33:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updating instance_info_cache with network_info: [{"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:33:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9a00c63a-b7d5-4626-b7aa-fc2e598840ec req-dd9889dc-2c67-42c7-84b8-efb838a01db1 service nova] Releasing lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-9456acc1-6dc3-47aa-bed3-a118c075fae0 req-00f18050-45b4-4d00-8817-a3dc0f99de56 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9456acc1-6dc3-47aa-bed3-a118c075fae0 req-00f18050-45b4-4d00-8817-a3dc0f99de56 service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9456acc1-6dc3-47aa-bed3-a118c075fae0 req-00f18050-45b4-4d00-8817-a3dc0f99de56 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9456acc1-6dc3-47aa-bed3-a118c075fae0 req-00f18050-45b4-4d00-8817-a3dc0f99de56 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-9456acc1-6dc3-47aa-bed3-a118c075fae0 req-00f18050-45b4-4d00-8817-a3dc0f99de56 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:33:04 user nova-compute[72904]: WARNING nova.compute.manager [req-9456acc1-6dc3-47aa-bed3-a118c075fae0 req-00f18050-45b4-4d00-8817-a3dc0f99de56 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received unexpected event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with vm_state building and task_state spawning.
Aug 27 05:33:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114386.299023, 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:33:06 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] VM Resumed (Lifecycle Event)
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:33:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Instance spawned successfully.
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:33:06 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114386.3005712, 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:33:06 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] VM Started (Lifecycle Event)
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-1249b7e5-8413-487a-a430-56310ef1dad2 req-8be65596-66ed-47e8-8430-ef0da09e558b service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1249b7e5-8413-487a-a430-56310ef1dad2 req-8be65596-66ed-47e8-8430-ef0da09e558b service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1249b7e5-8413-487a-a430-56310ef1dad2 req-8be65596-66ed-47e8-8430-ef0da09e558b service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1249b7e5-8413-487a-a430-56310ef1dad2 req-8be65596-66ed-47e8-8430-ef0da09e558b service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-1249b7e5-8413-487a-a430-56310ef1dad2 req-8be65596-66ed-47e8-8430-ef0da09e558b service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:33:06 user nova-compute[72904]: WARNING nova.compute.manager [req-1249b7e5-8413-487a-a430-56310ef1dad2 req-8be65596-66ed-47e8-8430-ef0da09e558b service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received unexpected event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with vm_state building and task_state spawning.
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:33:06 user nova-compute[72904]: INFO nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 27 05:33:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:33:06 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:33:06 user nova-compute[72904]: INFO nova.compute.manager [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Took 6.72 seconds to build instance.
Aug 27 05:33:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1123226b-cccb-47e2-9b3a-45f83a0c0d6d tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:33:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:33:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:33:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:33:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:33:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:33:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:33:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8308MB free_disk=25.34451675415039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:33:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance dfce3951-bee5-463e-ac61-031da58e4557 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance a5c5c054-1640-4c8d-9379-e732e0f2ae8e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 398aca08-15ea-487c-a012-a9a75b705b97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:33:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:33:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:33:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:33:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:33:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:33:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:33:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:33:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:33:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:33:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:33:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:33:56 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Updating instance_info_cache with network_info: [{"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-a5c5c054-1640-4c8d-9379-e732e0f2ae8e" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:33:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:33:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:10 user nova-compute[72904]: INFO nova.compute.manager [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Terminating instance
Aug 27 05:34:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-142c7b44-a4fa-4913-a2ed-ca3bebaab84b req-0bcec667-8d22-4be0-9992-0e52b793ad43 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received event network-vif-unplugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-142c7b44-a4fa-4913-a2ed-ca3bebaab84b req-0bcec667-8d22-4be0-9992-0e52b793ad43 service nova] Acquiring lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-142c7b44-a4fa-4913-a2ed-ca3bebaab84b req-0bcec667-8d22-4be0-9992-0e52b793ad43 service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-142c7b44-a4fa-4913-a2ed-ca3bebaab84b req-0bcec667-8d22-4be0-9992-0e52b793ad43 service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-142c7b44-a4fa-4913-a2ed-ca3bebaab84b req-0bcec667-8d22-4be0-9992-0e52b793ad43 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] No waiting events found dispatching network-vif-unplugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG nova.compute.manager [req-142c7b44-a4fa-4913-a2ed-ca3bebaab84b req-0bcec667-8d22-4be0-9992-0e52b793ad43 service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received event network-vif-unplugged-844adc6e-5862-4163-af44-3c0a463594fa for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:34:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:11 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Instance destroyed successfully.
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.objects.instance [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lazy-loading 'resources' on Instance uuid a5c5c054-1640-4c8d-9379-e732e0f2ae8e {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1693157828',display_name='tempest-VolumesActionsTest-instance-1693157828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1693157828',id=44,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:32:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c477fdf6d3c8445e92cb51ca9f3033c0',ramdisk_id='',reservation_id='r-1330sms0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1996509569',owner_user_name='tempest-VolumesActionsTest-1996509569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:32:13Z,user_data=None,user_id='928d869d131242558ef28f435579a622',uuid=a5c5c054-1640-4c8d-9379-e732e0f2ae8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Converting VIF {"id": "844adc6e-5862-4163-af44-3c0a463594fa", "address": "fa:16:3e:07:cd:d3", "network": {"id": "c8fb9754-1bed-44c2-b0fe-47effa011932", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1839859074-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c477fdf6d3c8445e92cb51ca9f3033c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap844adc6e-58", "ovs_interfaceid": "844adc6e-5862-4163-af44-3c0a463594fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:cd:d3,bridge_name='br-int',has_traffic_filtering=True,id=844adc6e-5862-4163-af44-3c0a463594fa,network=Network(c8fb9754-1bed-44c2-b0fe-47effa011932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844adc6e-58') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG os_vif [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:cd:d3,bridge_name='br-int',has_traffic_filtering=True,id=844adc6e-5862-4163-af44-3c0a463594fa,network=Network(c8fb9754-1bed-44c2-b0fe-47effa011932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844adc6e-58') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap844adc6e-58, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:11 user nova-compute[72904]: INFO os_vif [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:cd:d3,bridge_name='br-int',has_traffic_filtering=True,id=844adc6e-5862-4163-af44-3c0a463594fa,network=Network(c8fb9754-1bed-44c2-b0fe-47effa011932),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap844adc6e-58')
Aug 27 05:34:11 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Deleting instance files /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e_del
Aug 27 05:34:11 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Deletion of /opt/stack/data/nova/instances/a5c5c054-1640-4c8d-9379-e732e0f2ae8e_del complete
Aug 27 05:34:11 user nova-compute[72904]: INFO nova.compute.manager [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 05:34:11 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:34:11 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Took 0.55 seconds to deallocate network for instance.
Aug 27 05:34:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:34:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:11 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Deleted allocations for instance a5c5c054-1640-4c8d-9379-e732e0f2ae8e
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-9d69030f-9706-455a-99ba-c2ea671abe3a tempest-VolumesActionsTest-1996509569 tempest-VolumesActionsTest-1996509569-project-member] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.791s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-e418ee6e-26ea-46f3-99d5-a5646da1da6d req-b36e1004-41d2-4608-9564-dc1a3da9012b service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received event network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e418ee6e-26ea-46f3-99d5-a5646da1da6d req-b36e1004-41d2-4608-9564-dc1a3da9012b service nova] Acquiring lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e418ee6e-26ea-46f3-99d5-a5646da1da6d req-b36e1004-41d2-4608-9564-dc1a3da9012b service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e418ee6e-26ea-46f3-99d5-a5646da1da6d req-b36e1004-41d2-4608-9564-dc1a3da9012b service nova] Lock "a5c5c054-1640-4c8d-9379-e732e0f2ae8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-e418ee6e-26ea-46f3-99d5-a5646da1da6d req-b36e1004-41d2-4608-9564-dc1a3da9012b service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] No waiting events found dispatching network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.compute.manager [req-e418ee6e-26ea-46f3-99d5-a5646da1da6d req-b36e1004-41d2-4608-9564-dc1a3da9012b service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received unexpected event network-vif-plugged-844adc6e-5862-4163-af44-3c0a463594fa for instance with vm_state deleted and task_state None.
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-e418ee6e-26ea-46f3-99d5-a5646da1da6d req-b36e1004-41d2-4608-9564-dc1a3da9012b service nova] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Received event network-vif-deleted-844adc6e-5862-4163-af44-3c0a463594fa {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Verify base images {{(pid=72904) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Image id 946923b5-2c8b-4abd-9b8c-c0df6f5e9219 yields fingerprint a00880b1ad09db1117e0759ce506a92f5281b2f2 {{(pid=72904) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] image 946923b5-2c8b-4abd-9b8c-c0df6f5e9219 at (/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2): checking
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] image 946923b5-2c8b-4abd-9b8c-c0df6f5e9219 at (/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2): image is in use {{(pid=72904) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72904) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Image id f27bb442-d526-45c4-bb7d-830084f9191d yields fingerprint 18d9ac4603303140f47cb0f3140f60e0e0cf7685 {{(pid=72904) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] 398aca08-15ea-487c-a012-a9a75b705b97 is a valid instance name {{(pid=72904) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec is a valid instance name {{(pid=72904) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec has a disk file {{(pid=72904) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec is backed by a00880b1ad09db1117e0759ce506a92f5281b2f2 {{(pid=72904) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] dfce3951-bee5-463e-ac61-031da58e4557 is a valid instance name {{(pid=72904) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd
Aug 27 05:34:12 user nova-compute[72904]: WARNING nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Unknown base file: /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Active base files: /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Removable base files: /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704 /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11 /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/14ce9873b759e0455fea2ede6fc48aa72c0fee1b
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad3359466a1bcd1b9a057d28e5bb8be60eb247fc
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6d518e588337dd8bf360ba0cc54f1c859c86a704
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0c47d8505414b1c118d8aea24bd5dcab7898143b
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d1469654f05bf3410ad9defcf8f8a92aecabb3b
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/503908f04c91f9ec74bcbddf223270270ce2ae11
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f87b080bbb3122c4c679a27f0a9cf4b7b21b77db
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5823abeb3dfd275266fb95733e4b4fa2a39827dd
Aug 27 05:34:12 user nova-compute[72904]: INFO nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2efa25f258f0a3899b0a1abfcd1a9ee2bd6b3905
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Verification complete {{(pid=72904) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Verify swap images {{(pid=72904) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 27 05:34:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.imagecache [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Verify ephemeral images {{(pid=72904) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 27 05:34:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:26 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114451.0018525, a5c5c054-1640-4c8d-9379-e732e0f2ae8e => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:34:26 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] VM Stopped (Lifecycle Event)
Aug 27 05:34:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9862459e-2204-46b4-88ee-43e61665214c None None] [instance: a5c5c054-1640-4c8d-9379-e732e0f2ae8e] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:34:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-changed-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:26 user nova-compute[72904]: DEBUG nova.compute.manager [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Refreshing instance network info cache due to event network-changed-13b96b34-542d-4da2-a2f9-0deb0116a2ad. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:34:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] Acquiring lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:34:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] Acquired lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:34:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Refreshing network info cache for port 13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG nova.network.neutron [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updated VIF entry in instance network info cache for port 13b96b34-542d-4da2-a2f9-0deb0116a2ad. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG nova.network.neutron [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updating instance_info_cache with network_info: [{"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-79ca1198-9eb9-462b-b245-e85c3eae4f99 req-e57775a3-42a3-44c4-b69b-276022797921 service nova] Releasing lock "refresh_cache-398aca08-15ea-487c-a012-a9a75b705b97" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "398aca08-15ea-487c-a012-a9a75b705b97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "398aca08-15ea-487c-a012-a9a75b705b97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "398aca08-15ea-487c-a012-a9a75b705b97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:27 user nova-compute[72904]: INFO nova.compute.manager [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Terminating instance
Aug 27 05:34:27 user nova-compute[72904]: DEBUG nova.compute.manager [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:28 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Instance destroyed successfully.
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.objects.instance [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'resources' on Instance uuid 398aca08-15ea-487c-a012-a9a75b705b97 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1710060912',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1710060912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1710060912',id=45,image_ref='f27bb442-d526-45c4-bb7d-830084f9191d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJBT6eFjnPJR3P+MSyNksrmGUAaReAGSGwiVPPMfqpWAaIVlUcmSdmhfw5pvY/Gv2wbij89NsixagawE27m+c4INFuDXadLufF3GJNWG+zneuTgve6gaqVAAwi0H+Q2Kw==',key_name='tempest-keypair-1069314164',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:32:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-690s7nx9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1154964358',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=398aca08-15ea-487c-a012-a9a75b705b97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "address": "fa:16:3e:c7:79:ce", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13b96b34-54", "ovs_interfaceid": "13b96b34-542d-4da2-a2f9-0deb0116a2ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=13b96b34-542d-4da2-a2f9-0deb0116a2ad,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b96b34-54') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_vif [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=13b96b34-542d-4da2-a2f9-0deb0116a2ad,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b96b34-54') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13b96b34-54, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:28 user nova-compute[72904]: INFO os_vif [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:79:ce,bridge_name='br-int',has_traffic_filtering=True,id=13b96b34-542d-4da2-a2f9-0deb0116a2ad,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13b96b34-54')
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wHvIpCLX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:34:28 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a49b28-a8cf-41d2-aca0-66bc6ba52bf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b11ad4-4e2c-4cc1-be01-1617797388b7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:34:28 user nova-compute[72904]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 (non-flash)
Aug 27 05:34:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:34:28 user nova-compute[72904]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 (non-flash)
Aug 27 05:34:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f918c131fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc5f75-5146-4e96-aaf1-dc3c196411b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9525d1a-4437-4de1-b38d-a7c9e15bdad7]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3b71e6-ec43-4973-b7d2-198e96c60871]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b70247-49fd-4ac3-b409-6c94101962b4]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26635376164636432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1463df4') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:34:28 user nova-compute[72904]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26635376164636432
Aug 27 05:34:28 user nova-compute[72904]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a1463df4
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d93f9-b497-4cf5-9db4-5eac12940b08]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4818f689-6966-43a5-b55a-97cc3096decf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a12040-d450-41fa-9a06-8560df2f29bf]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260]
Aug 27 05:34:28 user nova-compute[72904]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761, portal: 172.16.0.220,3260] successful.
Aug 27 05:34:28 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3321af-3d45-41b8-bb13-c2484f4a3761 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bfdcc0-acff-462d-a2fa-c1962e97bc6d]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== disconnect_volume: return (281ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:34:28 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Deleting instance files /opt/stack/data/nova/instances/398aca08-15ea-487c-a012-a9a75b705b97_del
Aug 27 05:34:28 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Deletion of /opt/stack/data/nova/instances/398aca08-15ea-487c-a012-a9a75b705b97_del complete
Aug 27 05:34:28 user nova-compute[72904]: INFO nova.compute.manager [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-vif-unplugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] Acquiring lock "398aca08-15ea-487c-a012-a9a75b705b97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] No waiting events found dispatching network-vif-unplugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-vif-unplugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] Acquiring lock "398aca08-15ea-487c-a012-a9a75b705b97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] Lock "398aca08-15ea-487c-a012-a9a75b705b97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:28 user nova-compute[72904]: DEBUG nova.compute.manager [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] No waiting events found dispatching network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:34:28 user nova-compute[72904]: WARNING nova.compute.manager [req-496024f6-c222-47bc-9d30-5ed1b933dd1f req-36e6a770-b200-4153-9fcf-cf6e1ac362e2 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received unexpected event network-vif-plugged-13b96b34-542d-4da2-a2f9-0deb0116a2ad for instance with vm_state active and task_state deleting.
Aug 27 05:34:29 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:34:29 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Took 0.78 seconds to deallocate network for instance.
Aug 27 05:34:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-2db90c78-3fef-462d-a050-8639c20de05f req-4ad2b2c7-fdf3-4327-a037-1c1995d0bc05 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Received event network-vif-deleted-13b96b34-542d-4da2-a2f9-0deb0116a2ad {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:29 user nova-compute[72904]: INFO nova.compute.manager [req-2db90c78-3fef-462d-a050-8639c20de05f req-4ad2b2c7-fdf3-4327-a037-1c1995d0bc05 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Neutron deleted interface 13b96b34-542d-4da2-a2f9-0deb0116a2ad; detaching it from the instance and deleting it from the info cache
Aug 27 05:34:29 user nova-compute[72904]: DEBUG nova.network.neutron [req-2db90c78-3fef-462d-a050-8639c20de05f req-4ad2b2c7-fdf3-4327-a037-1c1995d0bc05 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:34:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-2db90c78-3fef-462d-a050-8639c20de05f req-4ad2b2c7-fdf3-4327-a037-1c1995d0bc05 service nova] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Detach interface failed, port_id=13b96b34-542d-4da2-a2f9-0deb0116a2ad, reason: Instance 398aca08-15ea-487c-a012-a9a75b705b97 could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:34:30 user nova-compute[72904]: INFO nova.compute.manager [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Took 0.79 seconds to detach 1 volumes for instance.
Aug 27 05:34:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Deleting volume: 9c3321af-3d45-41b8-bb13-c2484f4a3761 {{(pid=72904) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 05:34:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:30 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:34:30 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:34:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:30 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Deleted allocations for instance 398aca08-15ea-487c-a012-a9a75b705b97
Aug 27 05:34:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-21996593-d32d-49bb-9c66-2661867ba30d tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "398aca08-15ea-487c-a012-a9a75b705b97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114468.2352262, 398aca08-15ea-487c-a012-a9a75b705b97 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:34:43 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] VM Stopped (Lifecycle Event)
Aug 27 05:34:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9c35b82e-8162-458f-9576-a809b4d61bfb None None] [instance: 398aca08-15ea-487c-a012-a9a75b705b97] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:34:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:44 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:34:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:34:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:34:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8573MB free_disk=25.37109375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:34:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance dfce3951-bee5-463e-ac61-031da58e4557 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:34:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-changed-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:34:50 user nova-compute[72904]: DEBUG nova.compute.manager [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Refreshing instance network info cache due to event network-changed-54b7a0c2-ceef-4319-88fd-bf06b747ef29. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:34:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] Acquiring lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:34:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] Acquired lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:34:50 user nova-compute[72904]: DEBUG nova.network.neutron [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Refreshing network info cache for port 54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:34:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updated VIF entry in instance network info cache for port 54b7a0c2-ceef-4319-88fd-bf06b747ef29. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:34:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updating instance_info_cache with network_info: [{"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:34:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-3a217cb7-446f-4795-87bc-0cc1aeb1ef97 req-f372cb41-bdc8-4f6b-9510-60a99c35efcc service nova] Releasing lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:34:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:53 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:55 user nova-compute[72904]: INFO nova.compute.manager [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Attaching volume 5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 to /dev/vdb
Aug 27 05:34:55 user nova-compute[72904]: DEBUG os_brick.utils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76cdb3c-33fb-4ba6-80ca-ca922b597545]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1131785-bed2-45e3-8b3f-34ececd61854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c37d7b-1425-4fbd-9345-1952dddcd6d7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[598f9998-5bf6-4ef8-babe-bdb6b24c8960]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:34:55 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:34:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77920147-e1b1-4861-af33-957be04ee6db]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG os_brick.utils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:34:55 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updating existing volume attachment record: 056eb831-ff45-4b4a-bb70-add1de736b8c {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:34:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:34:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid dfce3951-bee5-463e-ac61-031da58e4557 {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "dfce3951-bee5-463e-ac61-031da58e4557" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:34:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "dfce3951-bee5-463e-ac61-031da58e4557" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:34:58 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid dfce3951-bee5-463e-ac61-031da58e4557 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:34:59 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating instance_info_cache with network_info: [{"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:34:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-dfce3951-bee5-463e-ac61-031da58e4557" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:34:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:35:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:35:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:35:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:35:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:35:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niFYXgmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:35:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:35:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:35:10 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d09d779-019c-46c3-b190-5074768edb79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:35:10 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1caf3db-e007-42cb-9fe1-3c6dd55bc384]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6] added
Aug 27 05:35:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4640db00-6696-47ec-9124-6e610f8493bf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[541bf7e1-0d07-4205-91f0-3fa2b0750b6e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niFYXgmL {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v niFYXgmL" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[78328753-68a3-4ce4-967d-42fde9b176a5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'niFYXgmL'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ad6be6-c58d-4275-832e-97dd821fd263]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e25b3b0-f037-409d-816a-2be6f1738d17]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b3a446-de06-492d-bb43-c3ff1c35ab90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260]
Aug 27 05:35:10 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260] successful.
Aug 27 05:35:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c0cccb-530a-418c-a4df-b2be86758a69]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[755f9d3d-67b0-426b-8442-92132fb205bb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:10 user nova-compute[72904]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 (non-flash)
Aug 27 05:35:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:10 user nova-compute[72904]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 (non-flash)
Aug 27 05:35:10 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3133c0a4-ca15-4269-a76a-bd936a640405]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:35:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niFYXgmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23137366435353435', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137366435353435', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:35:11 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:35:11 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:35:11 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:35:11 user nova-compute[72904]:   <serial>5d2c4a4b-0072-42c4-8f9e-43ccb66293b6</serial>
Aug 27 05:35:11 user nova-compute[72904]: </disk>
Aug 27 05:35:11 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:35:11 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No VIF found with MAC fa:16:3e:88:48:aa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:35:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb9996bb-482a-4d53-99cd-4cd1b0d2adcc tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.331s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.369s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:13 user nova-compute[72904]: INFO nova.compute.manager [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Detaching volume 5d2c4a4b-0072-42c4-8f9e-43ccb66293b6
Aug 27 05:35:13 user nova-compute[72904]: INFO nova.virt.block_device [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Attempting to driver detach volume 5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 from mountpoint /dev/vdb
Aug 27 05:35:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Attempting to detach device vdb from instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:35:13 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:35:13 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:35:13 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:35:13 user nova-compute[72904]:   <serial>5d2c4a4b-0072-42c4-8f9e-43ccb66293b6</serial>
Aug 27 05:35:13 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:35:13 user nova-compute[72904]: </disk>
Aug 27 05:35:13 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:35:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully detached device vdb from instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec from the persistent domain config.
Aug 27 05:35:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:35:13 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:35:13 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:35:13 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:35:13 user nova-compute[72904]:   <serial>5d2c4a4b-0072-42c4-8f9e-43ccb66293b6</serial>
Aug 27 05:35:13 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:35:13 user nova-compute[72904]: </disk>
Aug 27 05:35:13 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693114513.7331438, 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:35:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully detached device vdb from instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec from the live domain config.
Aug 27 05:35:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'niFYXgmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:35:13 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b837f81a-dc14-478e-b81f-8439f828b793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e057f70c-0695-4a81-9d45-f9df8e2db09d]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:13 user nova-compute[72904]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 (non-flash)
Aug 27 05:35:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:13 user nova-compute[72904]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 (non-flash)
Aug 27 05:35:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f918c132b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea0bbf1-b3f7-4e77-ad9b-e2555950c4ba]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3d5b71-1b8c-491f-bf3f-06ecad9a8b3e]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7eebc3-db06-4bc7-b9ec-23d20277926c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bceae2f-3122-4e42-bc57-55215f5d3041]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69cffb0-828d-4f17-b90d-102326804a51]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de05a6-ec9d-436e-9d5f-b02765fff839]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260]
Aug 27 05:35:13 user nova-compute[72904]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6, portal: 172.16.0.220,3260] successful.
Aug 27 05:35:13 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:13 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:14 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d2c4a4b-0072-42c4-8f9e-43ccb66293b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:14 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a24b6-e647-4762-a0ec-ce4ba8afdf42]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:35:14 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== disconnect_volume: return (270ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:35:14 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:35:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:35:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-781c828c-e279-46a1-ae1e-5b589384481f tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.436s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:35:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:35:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:35:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:35:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:35:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "dfce3951-bee5-463e-ac61-031da58e4557" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:25 user nova-compute[72904]: INFO nova.compute.manager [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Terminating instance
Aug 27 05:35:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-d7cc7709-d8f9-4dbf-9cb4-9096cf858522 req-7d74be9d-9405-4445-8a86-6ac805a76c97 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-vif-unplugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d7cc7709-d8f9-4dbf-9cb4-9096cf858522 req-7d74be9d-9405-4445-8a86-6ac805a76c97 service nova] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d7cc7709-d8f9-4dbf-9cb4-9096cf858522 req-7d74be9d-9405-4445-8a86-6ac805a76c97 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d7cc7709-d8f9-4dbf-9cb4-9096cf858522 req-7d74be9d-9405-4445-8a86-6ac805a76c97 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-d7cc7709-d8f9-4dbf-9cb4-9096cf858522 req-7d74be9d-9405-4445-8a86-6ac805a76c97 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] No waiting events found dispatching network-vif-unplugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-d7cc7709-d8f9-4dbf-9cb4-9096cf858522 req-7d74be9d-9405-4445-8a86-6ac805a76c97 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-vif-unplugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Instance destroyed successfully.
Aug 27 05:35:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'resources' on Instance uuid dfce3951-bee5-463e-ac61-031da58e4557 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-439146878',display_name='tempest-TestVolumeBootPattern-volume-backed-server-439146878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-439146878',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCC6Qa31FvKYC+/leStcBJGws1n2FNiuOmRF4iHS54D4UiprTzV5am1rljhH9xs4CE6kTgDBtE7XzR6gsQz3sxh84AdXKMMjKpSCXdmag0e8kPe2a5DSl5neo3SxBM5TQ==',key_name='tempest-keypair-1693054271',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:30:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-01l637fp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=dfce3951-bee5-463e-ac61-031da58e4557,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:35:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "address": "fa:16:3e:f6:b6:fe", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape71f5f4b-a0", "ovs_interfaceid": "e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:b6:fe,bridge_name='br-int',has_traffic_filtering=True,id=e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71f5f4b-a0') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_vif [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:b6:fe,bridge_name='br-int',has_traffic_filtering=True,id=e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71f5f4b-a0') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape71f5f4b-a0, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:35:26 user nova-compute[72904]: INFO os_vif [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:b6:fe,bridge_name='br-int',has_traffic_filtering=True,id=e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape71f5f4b-a0')
Aug 27 05:35:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OrUDSAbl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:35:26 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c98516-3e7e-47ef-9e06-aee910390699]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6cdbf-3abc-4d1b-8a2c-9a1e859dff83]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 (non-flash)
Aug 27 05:35:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c5995a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454'): ({'sdc'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Removing single pathed devices sdc {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[03548b74-4dbc-4f10-b4eb-225a7a1d74ab]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[08218e1b-a4ad-4074-a5dc-f6669c2eb20f]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flushing IO for device /dev/sdc {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb008563-1227-4e65-bfd9-9b0fe18a9b23]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3d9ba-efbc-462b-b50f-525a66410839]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4a210d8d-f4eab66202b93226', '/dev/disk/by-id/scsi-26634656162363632', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4a210d8d') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2c4533-e723-4f6d-a7ec-3c93599c8a29]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10a934b-26d0-4222-abf0-fc0ab1420eab]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7bf478-fd78-4b5e-9ad5-17b78fe4a2be]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260]
Aug 27 05:35:26 user nova-compute[72904]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454, portal: 172.16.0.220,3260] successful.
Aug 27 05:35:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a4f3e3-d103-4a2b-a308-845b5ba85454 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38bbefc-1335-4647-b060-d636242ee2da]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== disconnect_volume: return (298ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:35:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Deleting instance files /opt/stack/data/nova/instances/dfce3951-bee5-463e-ac61-031da58e4557_del
Aug 27 05:35:26 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Deletion of /opt/stack/data/nova/instances/dfce3951-bee5-463e-ac61-031da58e4557_del complete
Aug 27 05:35:26 user nova-compute[72904]: INFO nova.compute.manager [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 27 05:35:26 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:35:26 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: dfce3951-bee5-463e-ac61-031da58e4557] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:35:27 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:35:27 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Took 0.91 seconds to deallocate network for instance.
Aug 27 05:35:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-97c62f6e-aeb6-465c-852d-0257ba78491c req-75e1967f-d5fa-49b8-94a4-a8ff2a44ae38 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:35:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97c62f6e-aeb6-465c-852d-0257ba78491c req-75e1967f-d5fa-49b8-94a4-a8ff2a44ae38 service nova] Acquiring lock "dfce3951-bee5-463e-ac61-031da58e4557-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97c62f6e-aeb6-465c-852d-0257ba78491c req-75e1967f-d5fa-49b8-94a4-a8ff2a44ae38 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-97c62f6e-aeb6-465c-852d-0257ba78491c req-75e1967f-d5fa-49b8-94a4-a8ff2a44ae38 service nova] Lock "dfce3951-bee5-463e-ac61-031da58e4557-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-97c62f6e-aeb6-465c-852d-0257ba78491c req-75e1967f-d5fa-49b8-94a4-a8ff2a44ae38 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] No waiting events found dispatching network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:35:27 user nova-compute[72904]: WARNING nova.compute.manager [req-97c62f6e-aeb6-465c-852d-0257ba78491c req-75e1967f-d5fa-49b8-94a4-a8ff2a44ae38 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received unexpected event network-vif-plugged-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 for instance with vm_state active and task_state deleting.
Aug 27 05:35:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-97c62f6e-aeb6-465c-852d-0257ba78491c req-75e1967f-d5fa-49b8-94a4-a8ff2a44ae38 service nova] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Received event network-vif-deleted-e71f5f4b-a0a8-40f6-a5c7-4ec1daaf07c5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:35:30 user nova-compute[72904]: INFO nova.compute.manager [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Took 2.76 seconds to detach 1 volumes for instance.
Aug 27 05:35:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Deleting volume: 30a4f3e3-d103-4a2b-a308-845b5ba85454 {{(pid=72904) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 27 05:35:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:30 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:35:30 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:35:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:30 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Deleted allocations for instance dfce3951-bee5-463e-ac61-031da58e4557
Aug 27 05:35:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-35a5bdc5-bd5e-4f0e-b565-6322be69da99 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "dfce3951-bee5-463e-ac61-031da58e4557" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.198s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:40 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114525.9787111, dfce3951-bee5-463e-ac61-031da58e4557 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:35:40 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: dfce3951-bee5-463e-ac61-031da58e4557] VM Stopped (Lifecycle Event)
Aug 27 05:35:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-34d4b2fa-dc6c-4173-8ee2-52df0c71cefd None None] [instance: dfce3951-bee5-463e-ac61-031da58e4557] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:35:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:35:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:35:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:35:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:35:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:43 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:35:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:35:44 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:35:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=25.369033813476562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:35:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:35:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:35:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:35:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:35:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:35:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:35:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:35:58 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:35:59 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updating instance_info_cache with network_info: [{"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:35:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:35:59 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:35:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:35:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:03 user nova-compute[72904]: INFO nova.compute.manager [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Terminating instance
Aug 27 05:36:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-f356f86d-355b-48fc-a8f0-a0226693b280 req-4afe144b-ec5c-4dd2-b7f2-885f85deb7aa service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-unplugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f356f86d-355b-48fc-a8f0-a0226693b280 req-4afe144b-ec5c-4dd2-b7f2-885f85deb7aa service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f356f86d-355b-48fc-a8f0-a0226693b280 req-4afe144b-ec5c-4dd2-b7f2-885f85deb7aa service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-f356f86d-355b-48fc-a8f0-a0226693b280 req-4afe144b-ec5c-4dd2-b7f2-885f85deb7aa service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-f356f86d-355b-48fc-a8f0-a0226693b280 req-4afe144b-ec5c-4dd2-b7f2-885f85deb7aa service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-unplugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:36:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-f356f86d-355b-48fc-a8f0-a0226693b280 req-4afe144b-ec5c-4dd2-b7f2-885f85deb7aa service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-unplugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Instance destroyed successfully.
Aug 27 05:36:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'resources' on Instance uuid 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1924573234',display_name='tempest-AttachVolumeNegativeTest-server-1924573234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1924573234',id=46,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr4cCoGyXTrRxMbo7b1w0HFJ49g4xkaazP6blP3YxhSdd4D85EUxUoa5x3kTMmDEx2II65hVnynillZmMwA+xlgNDPlBJvM1XT5gizIbny/MDzLLryBQa00y7xl291G3Q==',key_name='tempest-keypair-279435540',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:33:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-n3hsjj04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:33:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "address": "fa:16:3e:88:48:aa", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b7a0c2-ce", "ovs_interfaceid": "54b7a0c2-ceef-4319-88fd-bf06b747ef29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:aa,bridge_name='br-int',has_traffic_filtering=True,id=54b7a0c2-ceef-4319-88fd-bf06b747ef29,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b7a0c2-ce') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG os_vif [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:aa,bridge_name='br-int',has_traffic_filtering=True,id=54b7a0c2-ceef-4319-88fd-bf06b747ef29,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b7a0c2-ce') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54b7a0c2-ce, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:36:04 user nova-compute[72904]: INFO os_vif [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:48:aa,bridge_name='br-int',has_traffic_filtering=True,id=54b7a0c2-ceef-4319-88fd-bf06b747ef29,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b7a0c2-ce')
Aug 27 05:36:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Deleting instance files /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec_del
Aug 27 05:36:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Deletion of /opt/stack/data/nova/instances/2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec_del complete
Aug 27 05:36:04 user nova-compute[72904]: INFO nova.compute.manager [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 05:36:04 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:36:05 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Took 1.45 seconds to deallocate network for instance.
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:36:05 user nova-compute[72904]: WARNING nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received unexpected event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with vm_state active and task_state deleting.
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:36:05 user nova-compute[72904]: WARNING nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received unexpected event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with vm_state active and task_state deleting.
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:36:05 user nova-compute[72904]: WARNING nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received unexpected event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with vm_state active and task_state deleting.
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-unplugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-unplugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-unplugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-deleted-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Acquiring lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] No waiting events found dispatching network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:36:05 user nova-compute[72904]: WARNING nova.compute.manager [req-af16bc5c-c26b-49cd-ba45-df732e209ff2 req-ca87a681-1d29-4372-87ca-73a7ca06a614 service nova] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Received unexpected event network-vif-plugged-54b7a0c2-ceef-4319-88fd-bf06b747ef29 for instance with vm_state active and task_state deleting.
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:06 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:36:06 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:36:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:06 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Deleted allocations for instance 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec
Aug 27 05:36:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-86d2c4b2-b6a1-44d2-8eed-98b9ea10d3df tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:19 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114564.3356218, 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:36:19 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] VM Stopped (Lifecycle Event)
Aug 27 05:36:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-b62dd8a8-55da-4811-926d-d17ddce941c5 None None] [instance: 2ba45a29-ba92-4b5c-a3d2-e63a0a3b6fec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:36:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:36:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:36:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:36:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:36:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:36:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.386268615722656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "51a40768-481c-49a4-8ec3-322b50e8cbe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:36:45 user nova-compute[72904]: INFO nova.compute.claims [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Claim successful on node user
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:36:45 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:36:45 user nova-compute[72904]: INFO nova.virt.block_device [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Booting with volume 90895414-f1f1-41d2-9430-b822156430fc at /dev/vda
Aug 27 05:36:45 user nova-compute[72904]: DEBUG nova.policy [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fd6f1e0a2843cca915e52045b78d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41729cc06fa94b569a46e971b769d96f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG os_brick.utils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[49acea41-3c27-4b62-832f-45df84914b17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[257fa58c-42e9-4fea-a4b6-7cdfaaf6ba7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b573466-990a-4c3c-b581-4998c0efbdd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3300473-8468-441b-99bd-cc03d5188e28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:36:46 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:36:46 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a185c7-be6e-46ef-afa3-f935e895a2a7]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG os_brick.utils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updating existing volume attachment record: e72fe76f-ac0c-4327-b268-734401414ddc {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:36:46 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Successfully created port: fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Successfully updated port: fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquired lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-changed-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Refreshing instance network info cache due to event network-changed-fbd4ee21-e450-4c03-be71-46dfc512d1b4. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] Acquiring lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.network.neutron [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updating instance_info_cache with network_info: [{"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Releasing lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Instance network_info: |[{"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] Acquired lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:36:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Refreshing network info cache for port fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:36:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updated VIF entry in instance network info cache for port fbd4ee21-e450-4c03-be71-46dfc512d1b4. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:36:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updating instance_info_cache with network_info: [{"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:36:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-44bc2396-9255-4f4d-99ad-97dec60d74c6 req-250ac291-d84c-46e0-9e6f-37b5194126d3 service nova] Releasing lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:36:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:50 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:36:57 user nova-compute[72904]: INFO nova.compute.claims [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Claim successful on node user
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:36:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:36:57 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.policy [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '008a26244e704805b8f77410645a4e7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63127190a4ad4846892961f9785fb132', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:36:58 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Creating image(s)
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "/opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "/opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.187s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk 1073741824" returned: 0 in 0.058s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Skipping network cache update for instance because it is Building. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Skipping network cache update for instance because it is Building. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Cannot resize image /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Ensure instance console log exists: /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:36:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:36:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:36:59 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Successfully created port: d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Successfully updated port: d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquired lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-changed-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Refreshing instance network info cache due to event network-changed-d1791500-d995-4fe7-b2e7-fbcfc773e260. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] Acquiring lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updating instance_info_cache with network_info: [{"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Releasing lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Instance network_info: |[{"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] Acquired lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.neutron [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Refreshing network info cache for port d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Start _get_guest_xml network_info=[{"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:37:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:37:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-815571604',display_name='tempest-AttachVolumeNegativeTest-server-815571604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-815571604',id=48,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMeShvo+7VTDiBBSUaEcaQaG128uk8DfLT0QCHPu1zFgFxdv4m3rLcKzjU+5uPwn6kQiPWYYFt39W+BZJt+XzvbpkRLHqU7sU2ycmXhOYN8TYteL1Gl/YUsTsoUwNe+8w==',key_name='tempest-keypair-119310547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-pj31nufh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=267c9aac-ac25-49f5-8c36-e2a6b52f48ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:4f:b2,bridge_name='br-int',has_traffic_filtering=True,id=d1791500-d995-4fe7-b2e7-fbcfc773e260,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1791500-d9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'pci_devices' on Instance uuid 267c9aac-ac25-49f5-8c36-e2a6b52f48ea {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:37:00 user nova-compute[72904]:   <uuid>267c9aac-ac25-49f5-8c36-e2a6b52f48ea</uuid>
Aug 27 05:37:00 user nova-compute[72904]:   <name>instance-00000030</name>
Aug 27 05:37:00 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:37:00 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:37:00 user nova-compute[72904]:   <metadata>
Aug 27 05:37:00 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:37:00 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:37:00 user nova-compute[72904]:       <nova:name>tempest-AttachVolumeNegativeTest-server-815571604</nova:name>
Aug 27 05:37:00 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:37:00</nova:creationTime>
Aug 27 05:37:00 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:37:00 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:37:00 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:37:00 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:37:00 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:37:00 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:37:00 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:37:00 user nova-compute[72904]:       <nova:owner>
Aug 27 05:37:00 user nova-compute[72904]:         <nova:user uuid="008a26244e704805b8f77410645a4e7f">tempest-AttachVolumeNegativeTest-159688162-project-member</nova:user>
Aug 27 05:37:00 user nova-compute[72904]:         <nova:project uuid="63127190a4ad4846892961f9785fb132">tempest-AttachVolumeNegativeTest-159688162</nova:project>
Aug 27 05:37:00 user nova-compute[72904]:       </nova:owner>
Aug 27 05:37:00 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:37:00 user nova-compute[72904]:       <nova:ports>
Aug 27 05:37:00 user nova-compute[72904]:         <nova:port uuid="d1791500-d995-4fe7-b2e7-fbcfc773e260">
Aug 27 05:37:00 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 27 05:37:00 user nova-compute[72904]:         </nova:port>
Aug 27 05:37:00 user nova-compute[72904]:       </nova:ports>
Aug 27 05:37:00 user nova-compute[72904]:     </nova:instance>
Aug 27 05:37:00 user nova-compute[72904]:   </metadata>
Aug 27 05:37:00 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:37:00 user nova-compute[72904]:     <system>
Aug 27 05:37:00 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:37:00 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:37:00 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:37:00 user nova-compute[72904]:       <entry name="serial">267c9aac-ac25-49f5-8c36-e2a6b52f48ea</entry>
Aug 27 05:37:00 user nova-compute[72904]:       <entry name="uuid">267c9aac-ac25-49f5-8c36-e2a6b52f48ea</entry>
Aug 27 05:37:00 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:37:00 user nova-compute[72904]:     </system>
Aug 27 05:37:00 user nova-compute[72904]:   </sysinfo>
Aug 27 05:37:00 user nova-compute[72904]:   <os>
Aug 27 05:37:00 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:37:00 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:37:00 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:37:00 user nova-compute[72904]:   </os>
Aug 27 05:37:00 user nova-compute[72904]:   <features>
Aug 27 05:37:00 user nova-compute[72904]:     <acpi/>
Aug 27 05:37:00 user nova-compute[72904]:     <apic/>
Aug 27 05:37:00 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:37:00 user nova-compute[72904]:   </features>
Aug 27 05:37:00 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:37:00 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:37:00 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:37:00 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:37:00 user nova-compute[72904]:   </clock>
Aug 27 05:37:00 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:37:00 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:37:00 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:37:00 user nova-compute[72904]:   </cpu>
Aug 27 05:37:00 user nova-compute[72904]:   <devices>
Aug 27 05:37:00 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:37:00 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:37:00 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk"/>
Aug 27 05:37:00 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:37:00 user nova-compute[72904]:     </disk>
Aug 27 05:37:00 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:37:00 user nova-compute[72904]:       <mac address="fa:16:3e:40:4f:b2"/>
Aug 27 05:37:00 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:37:00 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:37:00 user nova-compute[72904]:       <target dev="tapd1791500-d9"/>
Aug 27 05:37:00 user nova-compute[72904]:     </interface>
Aug 27 05:37:00 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:37:00 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/console.log" append="off"/>
Aug 27 05:37:00 user nova-compute[72904]:     </serial>
Aug 27 05:37:00 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:37:00 user nova-compute[72904]:     <video>
Aug 27 05:37:00 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:37:00 user nova-compute[72904]:     </video>
Aug 27 05:37:00 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:37:00 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:37:00 user nova-compute[72904]:     </rng>
Aug 27 05:37:00 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:37:00 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:37:00 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:37:00 user nova-compute[72904]:     </memballoon>
Aug 27 05:37:00 user nova-compute[72904]:   </devices>
Aug 27 05:37:00 user nova-compute[72904]: </domain>
Aug 27 05:37:00 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-815571604',display_name='tempest-AttachVolumeNegativeTest-server-815571604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-815571604',id=48,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMeShvo+7VTDiBBSUaEcaQaG128uk8DfLT0QCHPu1zFgFxdv4m3rLcKzjU+5uPwn6kQiPWYYFt39W+BZJt+XzvbpkRLHqU7sU2ycmXhOYN8TYteL1Gl/YUsTsoUwNe+8w==',key_name='tempest-keypair-119310547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-pj31nufh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=267c9aac-ac25-49f5-8c36-e2a6b52f48ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:4f:b2,bridge_name='br-int',has_traffic_filtering=True,id=d1791500-d995-4fe7-b2e7-fbcfc773e260,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1791500-d9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG os_vif [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:4f:b2,bridge_name='br-int',has_traffic_filtering=True,id=d1791500-d995-4fe7-b2e7-fbcfc773e260,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1791500-d9') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1791500-d9, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1791500-d9, col_values=(('external_ids', {'iface-id': 'd1791500-d995-4fe7-b2e7-fbcfc773e260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:4f:b2', 'vm-uuid': '267c9aac-ac25-49f5-8c36-e2a6b52f48ea'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:00 user nova-compute[72904]: INFO os_vif [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:4f:b2,bridge_name='br-int',has_traffic_filtering=True,id=d1791500-d995-4fe7-b2e7-fbcfc773e260,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1791500-d9')
Aug 27 05:37:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No VIF found with MAC fa:16:3e:40:4f:b2, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.neutron [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updated VIF entry in instance network info cache for port d1791500-d995-4fe7-b2e7-fbcfc773e260. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG nova.network.neutron [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updating instance_info_cache with network_info: [{"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:37:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c846e0f2-e68d-4a22-938e-37f31ac90fc8 req-6be50879-8861-4085-b486-d1ef4ddb756c service nova] Releasing lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:37:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:37:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-815dee9b-3d38-4b05-bf7b-fef4ccaf5690 req-2ac8e3a7-69f4-4355-ae91-8e201ffdf4a2 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-815dee9b-3d38-4b05-bf7b-fef4ccaf5690 req-2ac8e3a7-69f4-4355-ae91-8e201ffdf4a2 service nova] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-815dee9b-3d38-4b05-bf7b-fef4ccaf5690 req-2ac8e3a7-69f4-4355-ae91-8e201ffdf4a2 service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-815dee9b-3d38-4b05-bf7b-fef4ccaf5690 req-2ac8e3a7-69f4-4355-ae91-8e201ffdf4a2 service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-815dee9b-3d38-4b05-bf7b-fef4ccaf5690 req-2ac8e3a7-69f4-4355-ae91-8e201ffdf4a2 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] No waiting events found dispatching network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:37:02 user nova-compute[72904]: WARNING nova.compute.manager [req-815dee9b-3d38-4b05-bf7b-fef4ccaf5690 req-2ac8e3a7-69f4-4355-ae91-8e201ffdf4a2 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received unexpected event network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 for instance with vm_state building and task_state spawning.
Aug 27 05:37:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:37:03 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Creating image(s)
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Ensure instance console log exists: /opt/stack/data/nova/instances/51a40768-481c-49a4-8ec3-322b50e8cbe1/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Start _get_guest_xml network_info=[{"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e72fe76f-ac0c-4327-b268-734401414ddc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51a40768-481c-49a4-8ec3-322b50e8cbe1', 'attached_at': '', 'detached_at': '', 'volume_id': '90895414-f1f1-41d2-9430-b822156430fc', 'serial': '90895414-f1f1-41d2-9430-b822156430fc'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:37:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:37:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:37:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:37:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:37:03 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[816711f0-cc4c-4632-a6b7-71d0cd2c68d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:37:03 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98647f-1ace-4c34-a39d-09873e8d0526]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc] added
Aug 27 05:37:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5502da2-aa01-4bba-9150-baff8c8555b7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c7fa9-7c6f-4033-a638-6e4b3a9a7384]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkLzpYcB {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkLzpYcB" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bda643-a7c2-4d8b-8168-3494b0c425f9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkLzpYcB'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd94cb4-e935-4921-b7aa-0e39774a0795]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0fbc54-9042-4716-9754-f4d1e090b7c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:37:03 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:37:03 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:37:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:37:03 user nova-compute[72904]: 
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3ea2d-83c0-4555-9f60-eeffd9799927]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]
Aug 27 05:37:03 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.
Aug 27 05:37:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfbdaec-4091-4ce5-9078-0068b68881eb]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c689d1-5d81-4a0f-bc0d-e1d56849ba3e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:37:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:37:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3d9ffd-5f5a-418e-816a-25584623f3be]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:37:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114624.1009378, 267c9aac-ac25-49f5-8c36-e2a6b52f48ea => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:37:04 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] VM Resumed (Lifecycle Event)
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:37:04 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Instance spawned successfully.
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:04 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114624.1012452, 267c9aac-ac25-49f5-8c36-e2a6b52f48ea => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:37:04 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] VM Started (Lifecycle Event)
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:37:04 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:37:04 user nova-compute[72904]: INFO nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-7c8023f9-121d-4db7-8038-bb38ab9c7afd req-55983d37-693b-4186-bd9d-9cbdca63aa56 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7c8023f9-121d-4db7-8038-bb38ab9c7afd req-55983d37-693b-4186-bd9d-9cbdca63aa56 service nova] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7c8023f9-121d-4db7-8038-bb38ab9c7afd req-55983d37-693b-4186-bd9d-9cbdca63aa56 service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7c8023f9-121d-4db7-8038-bb38ab9c7afd req-55983d37-693b-4186-bd9d-9cbdca63aa56 service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-7c8023f9-121d-4db7-8038-bb38ab9c7afd req-55983d37-693b-4186-bd9d-9cbdca63aa56 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] No waiting events found dispatching network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:37:04 user nova-compute[72904]: WARNING nova.compute.manager [req-7c8023f9-121d-4db7-8038-bb38ab9c7afd req-55983d37-693b-4186-bd9d-9cbdca63aa56 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received unexpected event network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 for instance with vm_state building and task_state spawning.
Aug 27 05:37:04 user nova-compute[72904]: INFO nova.compute.manager [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Took 6.67 seconds to build instance.
Aug 27 05:37:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ff4fd8cf-0dfe-4a64-be85-61ef70849c07 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.771s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26536393766383335', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:37:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536393766383335', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1046993698',display_name='tempest-TestVolumeBootPattern-server-1046993698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1046993698',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-ymrwmooq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:36:46Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=51a40768-481c-49a4-8ec3-322b50e8cbe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1f:06,bridge_name='br-int',has_traffic_filtering=True,id=fbd4ee21-e450-4c03-be71-46dfc512d1b4,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd4ee21-e4') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'pci_devices' on Instance uuid 51a40768-481c-49a4-8ec3-322b50e8cbe1 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:37:05 user nova-compute[72904]:   <uuid>51a40768-481c-49a4-8ec3-322b50e8cbe1</uuid>
Aug 27 05:37:05 user nova-compute[72904]:   <name>instance-0000002f</name>
Aug 27 05:37:05 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:37:05 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:37:05 user nova-compute[72904]:   <metadata>
Aug 27 05:37:05 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:37:05 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:37:05 user nova-compute[72904]:       <nova:name>tempest-TestVolumeBootPattern-server-1046993698</nova:name>
Aug 27 05:37:05 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:37:03</nova:creationTime>
Aug 27 05:37:05 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:37:05 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:37:05 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:37:05 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:37:05 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:37:05 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:37:05 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:37:05 user nova-compute[72904]:       <nova:owner>
Aug 27 05:37:05 user nova-compute[72904]:         <nova:user uuid="75fd6f1e0a2843cca915e52045b78d4f">tempest-TestVolumeBootPattern-1154964358-project-member</nova:user>
Aug 27 05:37:05 user nova-compute[72904]:         <nova:project uuid="41729cc06fa94b569a46e971b769d96f">tempest-TestVolumeBootPattern-1154964358</nova:project>
Aug 27 05:37:05 user nova-compute[72904]:       </nova:owner>
Aug 27 05:37:05 user nova-compute[72904]:       <nova:ports>
Aug 27 05:37:05 user nova-compute[72904]:         <nova:port uuid="fbd4ee21-e450-4c03-be71-46dfc512d1b4">
Aug 27 05:37:05 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 05:37:05 user nova-compute[72904]:         </nova:port>
Aug 27 05:37:05 user nova-compute[72904]:       </nova:ports>
Aug 27 05:37:05 user nova-compute[72904]:     </nova:instance>
Aug 27 05:37:05 user nova-compute[72904]:   </metadata>
Aug 27 05:37:05 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:37:05 user nova-compute[72904]:     <system>
Aug 27 05:37:05 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:37:05 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:37:05 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:37:05 user nova-compute[72904]:       <entry name="serial">51a40768-481c-49a4-8ec3-322b50e8cbe1</entry>
Aug 27 05:37:05 user nova-compute[72904]:       <entry name="uuid">51a40768-481c-49a4-8ec3-322b50e8cbe1</entry>
Aug 27 05:37:05 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:37:05 user nova-compute[72904]:     </system>
Aug 27 05:37:05 user nova-compute[72904]:   </sysinfo>
Aug 27 05:37:05 user nova-compute[72904]:   <os>
Aug 27 05:37:05 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:37:05 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:37:05 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:37:05 user nova-compute[72904]:   </os>
Aug 27 05:37:05 user nova-compute[72904]:   <features>
Aug 27 05:37:05 user nova-compute[72904]:     <acpi/>
Aug 27 05:37:05 user nova-compute[72904]:     <apic/>
Aug 27 05:37:05 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:37:05 user nova-compute[72904]:   </features>
Aug 27 05:37:05 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:37:05 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:37:05 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:37:05 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:37:05 user nova-compute[72904]:   </clock>
Aug 27 05:37:05 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:37:05 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:37:05 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:37:05 user nova-compute[72904]:   </cpu>
Aug 27 05:37:05 user nova-compute[72904]:   <devices>
Aug 27 05:37:05 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:37:05 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:37:05 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:37:05 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:37:05 user nova-compute[72904]:       <serial>90895414-f1f1-41d2-9430-b822156430fc</serial>
Aug 27 05:37:05 user nova-compute[72904]:     </disk>
Aug 27 05:37:05 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:37:05 user nova-compute[72904]:       <mac address="fa:16:3e:9b:1f:06"/>
Aug 27 05:37:05 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:37:05 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:37:05 user nova-compute[72904]:       <target dev="tapfbd4ee21-e4"/>
Aug 27 05:37:05 user nova-compute[72904]:     </interface>
Aug 27 05:37:05 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:37:05 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/51a40768-481c-49a4-8ec3-322b50e8cbe1/console.log" append="off"/>
Aug 27 05:37:05 user nova-compute[72904]:     </serial>
Aug 27 05:37:05 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:37:05 user nova-compute[72904]:     <video>
Aug 27 05:37:05 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:37:05 user nova-compute[72904]:     </video>
Aug 27 05:37:05 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:37:05 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:37:05 user nova-compute[72904]:     </rng>
Aug 27 05:37:05 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:37:05 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:37:05 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:37:05 user nova-compute[72904]:     </memballoon>
Aug 27 05:37:05 user nova-compute[72904]:   </devices>
Aug 27 05:37:05 user nova-compute[72904]: </domain>
Aug 27 05:37:05 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1046993698',display_name='tempest-TestVolumeBootPattern-server-1046993698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1046993698',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-ymrwmooq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:36:46Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=51a40768-481c-49a4-8ec3-322b50e8cbe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1f:06,bridge_name='br-int',has_traffic_filtering=True,id=fbd4ee21-e450-4c03-be71-46dfc512d1b4,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd4ee21-e4') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG os_vif [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1f:06,bridge_name='br-int',has_traffic_filtering=True,id=fbd4ee21-e450-4c03-be71-46dfc512d1b4,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd4ee21-e4') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbd4ee21-e4, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbd4ee21-e4, col_values=(('external_ids', {'iface-id': 'fbd4ee21-e450-4c03-be71-46dfc512d1b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:1f:06', 'vm-uuid': '51a40768-481c-49a4-8ec3-322b50e8cbe1'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:05 user nova-compute[72904]: INFO os_vif [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:1f:06,bridge_name='br-int',has_traffic_filtering=True,id=fbd4ee21-e450-4c03-be71-46dfc512d1b4,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd4ee21-e4')
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:37:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No VIF found with MAC fa:16:3e:9b:1f:06, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3ef84d8-50b5-4ebc-ad46-09c3aedc3b74 req-2bf21693-80a8-45df-b8e4-d81f28785580 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3ef84d8-50b5-4ebc-ad46-09c3aedc3b74 req-2bf21693-80a8-45df-b8e4-d81f28785580 service nova] Acquiring lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3ef84d8-50b5-4ebc-ad46-09c3aedc3b74 req-2bf21693-80a8-45df-b8e4-d81f28785580 service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3ef84d8-50b5-4ebc-ad46-09c3aedc3b74 req-2bf21693-80a8-45df-b8e4-d81f28785580 service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3ef84d8-50b5-4ebc-ad46-09c3aedc3b74 req-2bf21693-80a8-45df-b8e4-d81f28785580 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] No waiting events found dispatching network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:37:06 user nova-compute[72904]: WARNING nova.compute.manager [req-e3ef84d8-50b5-4ebc-ad46-09c3aedc3b74 req-2bf21693-80a8-45df-b8e4-d81f28785580 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received unexpected event network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 for instance with vm_state building and task_state spawning.
Aug 27 05:37:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-b594dc34-8d1e-4819-a608-12206d2f0ddd req-a1501689-4a84-45ba-b3fb-8d14d07dd4a3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:37:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b594dc34-8d1e-4819-a608-12206d2f0ddd req-a1501689-4a84-45ba-b3fb-8d14d07dd4a3 service nova] Acquiring lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:37:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b594dc34-8d1e-4819-a608-12206d2f0ddd req-a1501689-4a84-45ba-b3fb-8d14d07dd4a3 service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:37:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b594dc34-8d1e-4819-a608-12206d2f0ddd req-a1501689-4a84-45ba-b3fb-8d14d07dd4a3 service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:08 user nova-compute[72904]: DEBUG nova.compute.manager [req-b594dc34-8d1e-4819-a608-12206d2f0ddd req-a1501689-4a84-45ba-b3fb-8d14d07dd4a3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] No waiting events found dispatching network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:37:08 user nova-compute[72904]: WARNING nova.compute.manager [req-b594dc34-8d1e-4819-a608-12206d2f0ddd req-a1501689-4a84-45ba-b3fb-8d14d07dd4a3 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received unexpected event network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 for instance with vm_state building and task_state spawning.
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114629.1010473, 51a40768-481c-49a4-8ec3-322b50e8cbe1 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:37:09 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] VM Resumed (Lifecycle Event)
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:37:09 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Instance spawned successfully.
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:37:09 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114629.1048124, 51a40768-481c-49a4-8ec3-322b50e8cbe1 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:37:09 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] VM Started (Lifecycle Event)
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:37:09 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:37:09 user nova-compute[72904]: INFO nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 27 05:37:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:37:09 user nova-compute[72904]: INFO nova.compute.manager [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Took 23.87 seconds to build instance.
Aug 27 05:37:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5c0b1bbb-8eed-4dba-b329-1e96345dc053 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.970s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:37:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:37:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=25.354537963867188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 51a40768-481c-49a4-8ec3-322b50e8cbe1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:37:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:37:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:37:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:37:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:37:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:37:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:37:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:37:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:38:00 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid 51a40768-481c-49a4-8ec3-322b50e8cbe1 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:38:01 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updating instance_info_cache with network_info: [{"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:38:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:38:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:38:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:38:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:38:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:38:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:38:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:38:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:38:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-changed-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Refreshing instance network info cache due to event network-changed-fbd4ee21-e450-4c03-be71-46dfc512d1b4. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] Acquiring lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] Acquired lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Refreshing network info cache for port fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "51a40768-481c-49a4-8ec3-322b50e8cbe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:38 user nova-compute[72904]: INFO nova.compute.manager [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Terminating instance
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.compute.manager [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updated VIF entry in instance network info cache for port fbd4ee21-e450-4c03-be71-46dfc512d1b4. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.network.neutron [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updating instance_info_cache with network_info: [{"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6a592162-7155-4807-9fd4-76040b4ca34b req-f3cfd7d7-b329-4522-9754-e42c4c21bf51 service nova] Releasing lock "refresh_cache-51a40768-481c-49a4-8ec3-322b50e8cbe1" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-6d3da910-65d8-44be-932e-e9f501bd0881 req-bb77172e-b92b-42be-b525-4f0451d3f48c service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-vif-unplugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6d3da910-65d8-44be-932e-e9f501bd0881 req-bb77172e-b92b-42be-b525-4f0451d3f48c service nova] Acquiring lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6d3da910-65d8-44be-932e-e9f501bd0881 req-bb77172e-b92b-42be-b525-4f0451d3f48c service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-6d3da910-65d8-44be-932e-e9f501bd0881 req-bb77172e-b92b-42be-b525-4f0451d3f48c service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-6d3da910-65d8-44be-932e-e9f501bd0881 req-bb77172e-b92b-42be-b525-4f0451d3f48c service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] No waiting events found dispatching network-vif-unplugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:38:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-6d3da910-65d8-44be-932e-e9f501bd0881 req-bb77172e-b92b-42be-b525-4f0451d3f48c service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-vif-unplugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:38:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Instance destroyed successfully.
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.objects.instance [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'resources' on Instance uuid 51a40768-481c-49a4-8ec3-322b50e8cbe1 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1046993698',display_name='tempest-TestVolumeBootPattern-server-1046993698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1046993698',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:37:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-ymrwmooq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:37:09Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=51a40768-481c-49a4-8ec3-322b50e8cbe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "address": "fa:16:3e:9b:1f:06", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd4ee21-e4", "ovs_interfaceid": "fbd4ee21-e450-4c03-be71-46dfc512d1b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:1f:06,bridge_name='br-int',has_traffic_filtering=True,id=fbd4ee21-e450-4c03-be71-46dfc512d1b4,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd4ee21-e4') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_vif [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:1f:06,bridge_name='br-int',has_traffic_filtering=True,id=fbd4ee21-e450-4c03-be71-46dfc512d1b4,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd4ee21-e4') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbd4ee21-e4, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:39 user nova-compute[72904]: INFO os_vif [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:1f:06,bridge_name='br-int',has_traffic_filtering=True,id=fbd4ee21-e450-4c03-be71-46dfc512d1b4,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd4ee21-e4')
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:38:39 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a717eb8e-811d-41d3-b1e9-52aebfc75cfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[de839265-4dd5-436e-b807-356272f8548b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:38:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:38:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7cc8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96c78bd-4646-4aa3-ac87-2deb535b425c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d23b9-b4f7-46d8-abb8-2e9c60cb2d8b]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[986d02b1-4f61-4ce4-95af-93c99d3b9e8c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[43694143-919c-44fd-acbb-1bbff556c081]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO99bcd251-e697f8351da058ba', '/dev/disk/by-id/scsi-26536393766383335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_99bcd251') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb74eaf6-65fd-4b50-a06b-a8854d19b6f2]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcce97c-463b-400e-bdb7-f983b7a62670]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ac1008-043e-4cd5-9cdf-eda9234d43ab]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]
Aug 27 05:38:39 user nova-compute[72904]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.
Aug 27 05:38:39 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[74932444-2bd5-4f92-8b39-02bcccca0c1a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== disconnect_volume: return (274ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:38:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Deleting instance files /opt/stack/data/nova/instances/51a40768-481c-49a4-8ec3-322b50e8cbe1_del
Aug 27 05:38:39 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Deletion of /opt/stack/data/nova/instances/51a40768-481c-49a4-8ec3-322b50e8cbe1_del complete
Aug 27 05:38:39 user nova-compute[72904]: INFO nova.compute.manager [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 27 05:38:39 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:38:39 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:38:40 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:38:40 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Took 0.94 seconds to deallocate network for instance.
Aug 27 05:38:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-d0d5e3b2-b0a2-47fa-8236-b685a518ec37 req-7af554d3-9ae9-45b8-bbef-da86a41b25d5 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:38:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d0d5e3b2-b0a2-47fa-8236-b685a518ec37 req-7af554d3-9ae9-45b8-bbef-da86a41b25d5 service nova] Acquiring lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d0d5e3b2-b0a2-47fa-8236-b685a518ec37 req-7af554d3-9ae9-45b8-bbef-da86a41b25d5 service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d0d5e3b2-b0a2-47fa-8236-b685a518ec37 req-7af554d3-9ae9-45b8-bbef-da86a41b25d5 service nova] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-d0d5e3b2-b0a2-47fa-8236-b685a518ec37 req-7af554d3-9ae9-45b8-bbef-da86a41b25d5 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] No waiting events found dispatching network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:38:41 user nova-compute[72904]: WARNING nova.compute.manager [req-d0d5e3b2-b0a2-47fa-8236-b685a518ec37 req-7af554d3-9ae9-45b8-bbef-da86a41b25d5 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received unexpected event network-vif-plugged-fbd4ee21-e450-4c03-be71-46dfc512d1b4 for instance with vm_state active and task_state deleting.
Aug 27 05:38:41 user nova-compute[72904]: DEBUG nova.compute.manager [req-d0d5e3b2-b0a2-47fa-8236-b685a518ec37 req-7af554d3-9ae9-45b8-bbef-da86a41b25d5 service nova] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Received event network-vif-deleted-fbd4ee21-e450-4c03-be71-46dfc512d1b4 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:38:41 user nova-compute[72904]: INFO nova.compute.manager [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Took 0.95 seconds to detach 1 volumes for instance.
Aug 27 05:38:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:41 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:38:42 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:38:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:42 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Deleted allocations for instance 51a40768-481c-49a4-8ec3-322b50e8cbe1
Aug 27 05:38:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-1ba25b4a-6c81-494f-8df0-711b0bc298e8 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "51a40768-481c-49a4-8ec3-322b50e8cbe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.530s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:44 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:38:45 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:38:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=25.352886199951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:38:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-changed-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:38:48 user nova-compute[72904]: DEBUG nova.compute.manager [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Refreshing instance network info cache due to event network-changed-d1791500-d995-4fe7-b2e7-fbcfc773e260. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:38:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] Acquiring lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:38:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] Acquired lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:38:48 user nova-compute[72904]: DEBUG nova.network.neutron [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Refreshing network info cache for port d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:38:49 user nova-compute[72904]: DEBUG nova.network.neutron [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updated VIF entry in instance network info cache for port d1791500-d995-4fe7-b2e7-fbcfc773e260. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:38:49 user nova-compute[72904]: DEBUG nova.network.neutron [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updating instance_info_cache with network_info: [{"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:38:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-73a0a433-0dbe-414f-9860-919248280b76 req-e27b841d-9b15-4d45-8460-6fde6834b6fc service nova] Releasing lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:38:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:38:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:52 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:53 user nova-compute[72904]: DEBUG nova.objects.instance [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid 267c9aac-ac25-49f5-8c36-e2a6b52f48ea {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:38:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:38:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:38:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:38:53 user nova-compute[72904]: INFO nova.compute.manager [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Attaching volume 41d2cf4a-ec01-4ddd-b643-6cf386f3fccd to /dev/vdb
Aug 27 05:38:54 user nova-compute[72904]: DEBUG os_brick.utils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa1c08-e7fb-4ede-88e0-1931573dbea5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14b9ae-f1fb-498d-8902-a64336a16d21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc921614-7007-434c-90d5-8870e54fa900]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb473071-09fc-446d-91ab-d0ca643a12e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:38:54 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:38:54 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9dfe8-0860-4e74-ac04-ad8670cee04c]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG os_brick.utils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updating existing volume attachment record: 044a70fb-bd9f-4968-b97e-916e780eb722 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114719.3911347, 51a40768-481c-49a4-8ec3-322b50e8cbe1 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:38:54 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] VM Stopped (Lifecycle Event)
Aug 27 05:38:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-9623dec6-3a3b-458f-b596-076f62e70e06 None None] [instance: 51a40768-481c-49a4-8ec3-322b50e8cbe1] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:38:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:38:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:38:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:38:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:39:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:39:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:39:01 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:39:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updating instance_info_cache with network_info: [{"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:39:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-267c9aac-ac25-49f5-8c36-e2a6b52f48ea" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:39:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:39:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:04 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwCebcFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:39:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:39:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:39:05 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[00756a8b-93df-4055-bc2d-dc6bac055e7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:39:05 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ace596-686e-4974-ba74-686a8d30b5b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd] added
Aug 27 05:39:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761c4ce-d0d5-49b6-b400-25892c0cfb2f]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f743780c-11ea-44b5-b1e6-7556b1a2f488]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwCebcFI {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwCebcFI" returned: 0 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0efdf6-af89-40b3-a9cc-a38085738cce]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwCebcFI'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cc297f-8308-48a9-bc35-c481798a0030]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[428b310d-93d6-434c-bcfb-22312b63b012]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:39:05 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:39:05 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:39:05 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:39:05 user nova-compute[72904]: 
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddcb680-12e6-4259-9b2c-a8a301d9f711]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260]
Aug 27 05:39:05 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260] successful.
Aug 27 05:39:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c917b2-8b14-4bf5-ab0c-580e9f6f81c5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e641431-c64f-4f8c-9b35-49ef48444aa9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd (non-flash)
Aug 27 05:39:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd (non-flash)
Aug 27 05:39:05 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc9e0df-e037-4143-af00-fb892ec24830]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:39:05 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwCebcFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:39:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:39:06 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26465353336633531', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:39:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465353336633531', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:39:06 user nova-compute[72904]: DEBUG nova.objects.instance [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid 267c9aac-ac25-49f5-8c36-e2a6b52f48ea {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:39:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:39:06 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:39:06 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:39:06 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:39:06 user nova-compute[72904]:   <serial>41d2cf4a-ec01-4ddd-b643-6cf386f3fccd</serial>
Aug 27 05:39:06 user nova-compute[72904]: </disk>
Aug 27 05:39:06 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:39:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:39:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:39:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] No VIF found with MAC fa:16:3e:40:4f:b2, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:39:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8d0918fc-8aaa-4a78-bcd7-4e96214224c4 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.155s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:08 user nova-compute[72904]: INFO nova.compute.manager [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Detaching volume 41d2cf4a-ec01-4ddd-b643-6cf386f3fccd
Aug 27 05:39:08 user nova-compute[72904]: INFO nova.virt.block_device [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Attempting to driver detach volume 41d2cf4a-ec01-4ddd-b643-6cf386f3fccd from mountpoint /dev/vdb
Aug 27 05:39:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Attempting to detach device vdb from instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:39:08 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:39:08 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:39:08 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:39:08 user nova-compute[72904]:   <serial>41d2cf4a-ec01-4ddd-b643-6cf386f3fccd</serial>
Aug 27 05:39:08 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:39:08 user nova-compute[72904]: </disk>
Aug 27 05:39:08 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:39:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully detached device vdb from instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea from the persistent domain config.
Aug 27 05:39:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:39:08 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:39:08 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:39:08 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:39:08 user nova-compute[72904]:   <serial>41d2cf4a-ec01-4ddd-b643-6cf386f3fccd</serial>
Aug 27 05:39:08 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:39:08 user nova-compute[72904]: </disk>
Aug 27 05:39:08 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693114748.8589976, 267c9aac-ac25-49f5-8c36-e2a6b52f48ea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:39:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully detached device vdb from instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea from the live domain config.
Aug 27 05:39:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwCebcFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:39:08 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5c888d-5dec-480b-bf90-aa25bf035362]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3bc84-1e96-4310-a43d-4800ae18f3fb]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd (non-flash)
Aug 27 05:39:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd (non-flash)
Aug 27 05:39:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c642dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7d7918-c769-42e7-83f0-6a212c674386]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[023960dc-a11e-45e0-8549-7f9231771813]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5e27d6-9f22-4a93-acab-10cf96b6b69e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:39:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7de9fd-378b-4035-80f0-d09c55bdcf3b]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f28f61-8572-422d-a961-d1851bda9664]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4819fc7e-d679-4a47-a849-a0dc7a750f67]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260]
Aug 27 05:39:09 user nova-compute[72904]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd, portal: 172.16.0.220,3260] successful.
Aug 27 05:39:09 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41d2cf4a-ec01-4ddd-b643-6cf386f3fccd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ee2b2-7cc1-4a06-98d7-2d58e39a0337]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] <== disconnect_volume: return (254ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'flavor' on Instance uuid 267c9aac-ac25-49f5-8c36-e2a6b52f48ea {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:39:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e9d7fbd1-5939-4eaf-9c9e-1686ca4d25d6 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:39:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:39:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:39:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:39:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "c486f7df-c440-455c-a152-f3a3a8d11140" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "c486f7df-c440-455c-a152-f3a3a8d11140" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:30 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:39:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:30 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:30 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:39:30 user nova-compute[72904]: INFO nova.compute.claims [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Claim successful on node user
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.network.neutron [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:39:31 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:39:31 user nova-compute[72904]: INFO nova.virt.block_device [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Booting with volume 90895414-f1f1-41d2-9430-b822156430fc at /dev/vda
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.policy [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fd6f1e0a2843cca915e52045b78d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41729cc06fa94b569a46e971b769d96f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG os_brick.utils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d8cd8-197b-40de-a513-45a4c1af6a2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9ab18-8307-40d1-9670-17407eb451f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[218539d6-9427-438b-bbc1-ad4c7f0684b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[689f0cea-d218-4c8f-9c86-dcdc12f6348e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:39:31 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:39:31 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3350a670-4733-4c91-8b6b-f71a3d6bf381]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG os_brick.utils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:39:31 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating existing volume attachment record: 092765a9-f4ee-4a97-b3e7-165d5256910c {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:39:32 user nova-compute[72904]: DEBUG nova.network.neutron [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Successfully created port: e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Successfully updated port: e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-changed-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Refreshing instance network info cache due to event network-changed-e8866ba5-477e-4a58-9e11-1d0382910cf9. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.network.neutron [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Instance network_info: |[{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:39:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Refreshing network info cache for port e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:39:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updated VIF entry in instance network info cache for port e8866ba5-477e-4a58-9e11-1d0382910cf9. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:39:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:39:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-642ee6f9-6a1e-4c50-8f7f-076090528fd8 req-f84371eb-320f-4ef2-a5bd-75f7b5aefce2 service nova] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:39:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:39:42 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Creating image(s)
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Ensure instance console log exists: /opt/stack/data/nova/instances/c486f7df-c440-455c-a152-f3a3a8d11140/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Start _get_guest_xml network_info=[{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '092765a9-f4ee-4a97-b3e7-165d5256910c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c486f7df-c440-455c-a152-f3a3a8d11140', 'attached_at': '', 'detached_at': '', 'volume_id': '90895414-f1f1-41d2-9430-b822156430fc', 'serial': '90895414-f1f1-41d2-9430-b822156430fc'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:39:42 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:39:42 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:39:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:39:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:39:42 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cdcfbd-9578-44cd-970a-8a6c141e7ad8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:39:42 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0678dd9-bbc3-4057-979a-bf12b975721a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc] added
Aug 27 05:39:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3981a8e9-7ddf-405f-8498-8e5c1af059fe]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acf7b61-a82c-4d4d-aead-1d9b609bc2cc]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkLzpYcB {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AkLzpYcB" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafff13f-3c18-44c4-896f-24973d878748]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AkLzpYcB'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f63b0-2e95-49bc-b6fd-72923b95fe8c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0ab75d-c26e-47c2-be0b-4ae575925abd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:39:42 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:39:42 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:39:42 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:39:42 user nova-compute[72904]: 
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c97d0-a7da-4ec4-b561-6fc77f2cbbdc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]
Aug 27 05:39:42 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.
Aug 27 05:39:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6edd3e-8759-4496-9ed2-8f416e7031d6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c61e3c6-1686-4ee0-a1f4-4e6fb8a2f675]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:39:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:39:42 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[109dcf49-ee0f-49bf-847b-ae15d9a099c5]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:39:42 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.256s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== connect_volume: return (1258ms) {'type': 'block', 'scsi_wwn': '26536393766383335', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536393766383335', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-418353364',display_name='tempest-TestVolumeBootPattern-server-418353364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-418353364',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-viipatq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:39:31Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=c486f7df-c440-455c-a152-f3a3a8d11140,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:01,bridge_name='br-int',has_traffic_filtering=True,id=e8866ba5-477e-4a58-9e11-1d0382910cf9,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8866ba5-47') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'pci_devices' on Instance uuid c486f7df-c440-455c-a152-f3a3a8d11140 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:39:43 user nova-compute[72904]:   <uuid>c486f7df-c440-455c-a152-f3a3a8d11140</uuid>
Aug 27 05:39:43 user nova-compute[72904]:   <name>instance-00000031</name>
Aug 27 05:39:43 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:39:43 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:39:43 user nova-compute[72904]:   <metadata>
Aug 27 05:39:43 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:39:43 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:39:43 user nova-compute[72904]:       <nova:name>tempest-TestVolumeBootPattern-server-418353364</nova:name>
Aug 27 05:39:43 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:39:42</nova:creationTime>
Aug 27 05:39:43 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:39:43 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:39:43 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:39:43 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:39:43 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:39:43 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:39:43 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:39:43 user nova-compute[72904]:       <nova:owner>
Aug 27 05:39:43 user nova-compute[72904]:         <nova:user uuid="75fd6f1e0a2843cca915e52045b78d4f">tempest-TestVolumeBootPattern-1154964358-project-member</nova:user>
Aug 27 05:39:43 user nova-compute[72904]:         <nova:project uuid="41729cc06fa94b569a46e971b769d96f">tempest-TestVolumeBootPattern-1154964358</nova:project>
Aug 27 05:39:43 user nova-compute[72904]:       </nova:owner>
Aug 27 05:39:43 user nova-compute[72904]:       <nova:ports>
Aug 27 05:39:43 user nova-compute[72904]:         <nova:port uuid="e8866ba5-477e-4a58-9e11-1d0382910cf9">
Aug 27 05:39:43 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 27 05:39:43 user nova-compute[72904]:         </nova:port>
Aug 27 05:39:43 user nova-compute[72904]:       </nova:ports>
Aug 27 05:39:43 user nova-compute[72904]:     </nova:instance>
Aug 27 05:39:43 user nova-compute[72904]:   </metadata>
Aug 27 05:39:43 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:39:43 user nova-compute[72904]:     <system>
Aug 27 05:39:43 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:39:43 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:39:43 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:39:43 user nova-compute[72904]:       <entry name="serial">c486f7df-c440-455c-a152-f3a3a8d11140</entry>
Aug 27 05:39:43 user nova-compute[72904]:       <entry name="uuid">c486f7df-c440-455c-a152-f3a3a8d11140</entry>
Aug 27 05:39:43 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:39:43 user nova-compute[72904]:     </system>
Aug 27 05:39:43 user nova-compute[72904]:   </sysinfo>
Aug 27 05:39:43 user nova-compute[72904]:   <os>
Aug 27 05:39:43 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:39:43 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:39:43 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:39:43 user nova-compute[72904]:   </os>
Aug 27 05:39:43 user nova-compute[72904]:   <features>
Aug 27 05:39:43 user nova-compute[72904]:     <acpi/>
Aug 27 05:39:43 user nova-compute[72904]:     <apic/>
Aug 27 05:39:43 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:39:43 user nova-compute[72904]:   </features>
Aug 27 05:39:43 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:39:43 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:39:43 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:39:43 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:39:43 user nova-compute[72904]:   </clock>
Aug 27 05:39:43 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:39:43 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:39:43 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:39:43 user nova-compute[72904]:   </cpu>
Aug 27 05:39:43 user nova-compute[72904]:   <devices>
Aug 27 05:39:43 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:39:43 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:39:43 user nova-compute[72904]:       <source dev="/dev/sdb"/>
Aug 27 05:39:43 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:39:43 user nova-compute[72904]:       <serial>90895414-f1f1-41d2-9430-b822156430fc</serial>
Aug 27 05:39:43 user nova-compute[72904]:     </disk>
Aug 27 05:39:43 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:39:43 user nova-compute[72904]:       <mac address="fa:16:3e:d0:1f:01"/>
Aug 27 05:39:43 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:39:43 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:39:43 user nova-compute[72904]:       <target dev="tape8866ba5-47"/>
Aug 27 05:39:43 user nova-compute[72904]:     </interface>
Aug 27 05:39:43 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:39:43 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/c486f7df-c440-455c-a152-f3a3a8d11140/console.log" append="off"/>
Aug 27 05:39:43 user nova-compute[72904]:     </serial>
Aug 27 05:39:43 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:39:43 user nova-compute[72904]:     <video>
Aug 27 05:39:43 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:39:43 user nova-compute[72904]:     </video>
Aug 27 05:39:43 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:39:43 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:39:43 user nova-compute[72904]:     </rng>
Aug 27 05:39:43 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:39:43 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:39:43 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:39:43 user nova-compute[72904]:     </memballoon>
Aug 27 05:39:43 user nova-compute[72904]:   </devices>
Aug 27 05:39:43 user nova-compute[72904]: </domain>
Aug 27 05:39:43 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-418353364',display_name='tempest-TestVolumeBootPattern-server-418353364',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-418353364',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-viipatq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:39:31Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=c486f7df-c440-455c-a152-f3a3a8d11140,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:01,bridge_name='br-int',has_traffic_filtering=True,id=e8866ba5-477e-4a58-9e11-1d0382910cf9,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8866ba5-47') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG os_vif [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:01,bridge_name='br-int',has_traffic_filtering=True,id=e8866ba5-477e-4a58-9e11-1d0382910cf9,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8866ba5-47') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8866ba5-47, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8866ba5-47, col_values=(('external_ids', {'iface-id': 'e8866ba5-477e-4a58-9e11-1d0382910cf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:1f:01', 'vm-uuid': 'c486f7df-c440-455c-a152-f3a3a8d11140'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:43 user nova-compute[72904]: INFO os_vif [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:1f:01,bridge_name='br-int',has_traffic_filtering=True,id=e8866ba5-477e-4a58-9e11-1d0382910cf9,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8866ba5-47')
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:39:43 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No VIF found with MAC fa:16:3e:d0:1f:01, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e1ad135-fb02-44b3-8ee8-010d43278da0 req-d6167478-2157-4fa6-b578-041906c39356 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e1ad135-fb02-44b3-8ee8-010d43278da0 req-d6167478-2157-4fa6-b578-041906c39356 service nova] Acquiring lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e1ad135-fb02-44b3-8ee8-010d43278da0 req-d6167478-2157-4fa6-b578-041906c39356 service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-8e1ad135-fb02-44b3-8ee8-010d43278da0 req-d6167478-2157-4fa6-b578-041906c39356 service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG nova.compute.manager [req-8e1ad135-fb02-44b3-8ee8-010d43278da0 req-d6167478-2157-4fa6-b578-041906c39356 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] No waiting events found dispatching network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:39:45 user nova-compute[72904]: WARNING nova.compute.manager [req-8e1ad135-fb02-44b3-8ee8-010d43278da0 req-d6167478-2157-4fa6-b578-041906c39356 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received unexpected event network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 for instance with vm_state building and task_state spawning.
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:45 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:39:46 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:39:46 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114787.0274, c486f7df-c440-455c-a152-f3a3a8d11140 => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:39:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] VM Resumed (Lifecycle Event)
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:39:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:39:47 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=25.342464447021484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Instance spawned successfully.
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:39:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114787.028594, c486f7df-c440-455c-a152-f3a3a8d11140 => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:39:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] VM Started (Lifecycle Event)
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:39:47 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:39:47 user nova-compute[72904]: INFO nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Took 4.96 seconds to spawn the instance on the hypervisor.
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:39:47 user nova-compute[72904]: INFO nova.compute.manager [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Took 16.62 seconds to build instance.
Aug 27 05:39:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cef3f8b0-f668-4662-8899-ded5d15c22ad tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "c486f7df-c440-455c-a152-f3a3a8d11140" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.728s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-e8cb0695-0339-463e-b131-c3977602c4d8 req-46d0bbad-e18b-4010-9fb0-0eedcb302623 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e8cb0695-0339-463e-b131-c3977602c4d8 req-46d0bbad-e18b-4010-9fb0-0eedcb302623 service nova] Acquiring lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e8cb0695-0339-463e-b131-c3977602c4d8 req-46d0bbad-e18b-4010-9fb0-0eedcb302623 service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e8cb0695-0339-463e-b131-c3977602c4d8 req-46d0bbad-e18b-4010-9fb0-0eedcb302623 service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-e8cb0695-0339-463e-b131-c3977602c4d8 req-46d0bbad-e18b-4010-9fb0-0eedcb302623 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] No waiting events found dispatching network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:39:47 user nova-compute[72904]: WARNING nova.compute.manager [req-e8cb0695-0339-463e-b131-c3977602c4d8 req-46d0bbad-e18b-4010-9fb0-0eedcb302623 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received unexpected event network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 for instance with vm_state active and task_state None.
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c486f7df-c440-455c-a152-f3a3a8d11140 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:39:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:39:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:39:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:39:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:39:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:39:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:39:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:58 user nova-compute[72904]: INFO nova.compute.manager [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Terminating instance
Aug 27 05:39:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-1eb7ab85-8968-4c16-9151-1dba346ea682 req-fd5f5786-b6da-40a0-9dfa-c12f7b31182c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-vif-unplugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1eb7ab85-8968-4c16-9151-1dba346ea682 req-fd5f5786-b6da-40a0-9dfa-c12f7b31182c service nova] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1eb7ab85-8968-4c16-9151-1dba346ea682 req-fd5f5786-b6da-40a0-9dfa-c12f7b31182c service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1eb7ab85-8968-4c16-9151-1dba346ea682 req-fd5f5786-b6da-40a0-9dfa-c12f7b31182c service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-1eb7ab85-8968-4c16-9151-1dba346ea682 req-fd5f5786-b6da-40a0-9dfa-c12f7b31182c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] No waiting events found dispatching network-vif-unplugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:39:58 user nova-compute[72904]: DEBUG nova.compute.manager [req-1eb7ab85-8968-4c16-9151-1dba346ea682 req-fd5f5786-b6da-40a0-9dfa-c12f7b31182c service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-vif-unplugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:39:59 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Instance destroyed successfully.
Aug 27 05:39:59 user nova-compute[72904]: DEBUG nova.objects.instance [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lazy-loading 'resources' on Instance uuid 267c9aac-ac25-49f5-8c36-e2a6b52f48ea {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-815571604',display_name='tempest-AttachVolumeNegativeTest-server-815571604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-815571604',id=48,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMeShvo+7VTDiBBSUaEcaQaG128uk8DfLT0QCHPu1zFgFxdv4m3rLcKzjU+5uPwn6kQiPWYYFt39W+BZJt+XzvbpkRLHqU7sU2ycmXhOYN8TYteL1Gl/YUsTsoUwNe+8w==',key_name='tempest-keypair-119310547',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:37:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63127190a4ad4846892961f9785fb132',ramdisk_id='',reservation_id='r-pj31nufh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-159688162',owner_user_name='tempest-AttachVolumeNegativeTest-159688162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:37:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='008a26244e704805b8f77410645a4e7f',uuid=267c9aac-ac25-49f5-8c36-e2a6b52f48ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converting VIF {"id": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "address": "fa:16:3e:40:4f:b2", "network": {"id": "142d1618-236d-4d36-889e-10f4184f33e5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1362834156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63127190a4ad4846892961f9785fb132", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1791500-d9", "ovs_interfaceid": "d1791500-d995-4fe7-b2e7-fbcfc773e260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:4f:b2,bridge_name='br-int',has_traffic_filtering=True,id=d1791500-d995-4fe7-b2e7-fbcfc773e260,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1791500-d9') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG os_vif [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:4f:b2,bridge_name='br-int',has_traffic_filtering=True,id=d1791500-d995-4fe7-b2e7-fbcfc773e260,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1791500-d9') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1791500-d9, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:39:59 user nova-compute[72904]: INFO os_vif [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:4f:b2,bridge_name='br-int',has_traffic_filtering=True,id=d1791500-d995-4fe7-b2e7-fbcfc773e260,network=Network(142d1618-236d-4d36-889e-10f4184f33e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1791500-d9')
Aug 27 05:39:59 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Deleting instance files /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea_del
Aug 27 05:39:59 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Deletion of /opt/stack/data/nova/instances/267c9aac-ac25-49f5-8c36-e2a6b52f48ea_del complete
Aug 27 05:39:59 user nova-compute[72904]: INFO nova.compute.manager [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 27 05:39:59 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:39:59 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:40:00 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Took 0.91 seconds to deallocate network for instance.
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:00 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Deleted allocations for instance 267c9aac-ac25-49f5-8c36-e2a6b52f48ea
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-c5892e87-b05e-4226-bcd7-6c1306068bc1 tempest-AttachVolumeNegativeTest-159688162 tempest-AttachVolumeNegativeTest-159688162-project-member] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ac3d82e-8263-49b9-8184-af16bf97aba3 req-2cbc7946-3eae-445b-9e04-795e7200c043 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ac3d82e-8263-49b9-8184-af16bf97aba3 req-2cbc7946-3eae-445b-9e04-795e7200c043 service nova] Acquiring lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ac3d82e-8263-49b9-8184-af16bf97aba3 req-2cbc7946-3eae-445b-9e04-795e7200c043 service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9ac3d82e-8263-49b9-8184-af16bf97aba3 req-2cbc7946-3eae-445b-9e04-795e7200c043 service nova] Lock "267c9aac-ac25-49f5-8c36-e2a6b52f48ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:40:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ac3d82e-8263-49b9-8184-af16bf97aba3 req-2cbc7946-3eae-445b-9e04-795e7200c043 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] No waiting events found dispatching network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:40:00 user nova-compute[72904]: WARNING nova.compute.manager [req-9ac3d82e-8263-49b9-8184-af16bf97aba3 req-2cbc7946-3eae-445b-9e04-795e7200c043 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received unexpected event network-vif-plugged-d1791500-d995-4fe7-b2e7-fbcfc773e260 for instance with vm_state deleted and task_state None.
Aug 27 05:40:00 user nova-compute[72904]: DEBUG nova.compute.manager [req-9ac3d82e-8263-49b9-8184-af16bf97aba3 req-2cbc7946-3eae-445b-9e04-795e7200c043 service nova] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Received event network-vif-deleted-d1791500-d995-4fe7-b2e7-fbcfc773e260 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:40:02 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid c486f7df-c440-455c-a152-f3a3a8d11140 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:40:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:40:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:40:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:40:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:40:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:40:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:14 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693114799.3823001, 267c9aac-ac25-49f5-8c36-e2a6b52f48ea => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:40:14 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] VM Stopped (Lifecycle Event)
Aug 27 05:40:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-65b1d862-d03f-4871-a5a1-70ea55f928a2 None None] [instance: 267c9aac-ac25-49f5-8c36-e2a6b52f48ea] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:40:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:31 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:40:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:40:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:40:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:40:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:40:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:40:47 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:40:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:40:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:40:47 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:40:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:40:48 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:40:48 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:40:48 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=25.369251251220703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c486f7df-c440-455c-a152-f3a3a8d11140 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:40:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:40:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:40:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:40:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:40:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:40:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:41:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:41:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:41:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:41:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:41:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:41:03 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid c486f7df-c440-455c-a152-f3a3a8d11140 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:41:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:41:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:41:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:41:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:04 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:14 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:41:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-changed-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG nova.compute.manager [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Refreshing instance network info cache due to event network-changed-e8866ba5-477e-4a58-9e11-1d0382910cf9. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Refreshing network info cache for port e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updated VIF entry in instance network info cache for port e8866ba5-477e-4a58-9e11-1d0382910cf9. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG nova.network.neutron [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:41:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-817193e7-49ed-4ccf-8c22-fc267ace2f83 req-c2798db9-a6b5-4317-bc97-7102cb1965e8 service nova] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:41:24 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:41:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:29 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:34 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:39 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "d639ed42-e808-4722-a5dd-da5948cc26bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:41:41 user nova-compute[72904]: INFO nova.compute.claims [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Claim successful on node user
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.network.neutron [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:41:41 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:41:41 user nova-compute[72904]: INFO nova.virt.block_device [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Booting with volume 5085559b-47dd-4d62-b9bb-f36adda67b30 at /dev/vda
Aug 27 05:41:41 user nova-compute[72904]: DEBUG nova.policy [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75fd6f1e0a2843cca915e52045b78d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41729cc06fa94b569a46e971b769d96f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG os_brick.utils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a418124-595a-42f7-a5b9-596d56614a8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d39608f-28fd-4b30-8bc2-690f3e90c905]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dfa96a-74bb-47f6-9de3-11a182e04a25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9052e2-5d4c-45fb-bed8-4c6e7893e6ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:41:41 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:41:42 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:41:42 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[08818004-a6e8-48c4-9c96-8c9b3c81b8b5]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG os_brick.utils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updating existing volume attachment record: c469391f-9bc4-44b5-9627-f9fd6c3deccc {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG nova.network.neutron [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Successfully created port: 19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:41:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Successfully updated port: 19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquired lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-changed-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.compute.manager [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Refreshing instance network info cache due to event network-changed-19a90ae3-03b3-41b0-8bfd-97e694575fb2. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] Acquiring lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.network.neutron [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updating instance_info_cache with network_info: [{"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Releasing lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Instance network_info: |[{"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] Acquired lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:41:43 user nova-compute[72904]: DEBUG nova.network.neutron [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Refreshing network info cache for port 19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:41:44 user nova-compute[72904]: DEBUG nova.network.neutron [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updated VIF entry in instance network info cache for port 19a90ae3-03b3-41b0-8bfd-97e694575fb2. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:41:44 user nova-compute[72904]: DEBUG nova.network.neutron [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updating instance_info_cache with network_info: [{"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:41:44 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ebe79975-c2f7-4dae-85db-9deb1ffb9748 req-b94e394d-a367-44c4-ba8d-c55ae4956993 service nova] Releasing lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:41:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:48 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:41:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:41:48 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:41:48 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:41:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:41:49 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:41:49 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.366695404052734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c486f7df-c440-455c-a152-f3a3a8d11140 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d639ed42-e808-4722-a5dd-da5948cc26bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:41:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:41:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:54 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:41:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:41:58 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:41:59 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:42:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Creating image(s)
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Did not create local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Ensure instance console log exists: /opt/stack/data/nova/instances/d639ed42-e808-4722-a5dd-da5948cc26bc/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Start _get_guest_xml network_info=[{"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c469391f-9bc4-44b5-9627-f9fd6c3deccc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvFPSgem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd639ed42-e808-4722-a5dd-da5948cc26bc', 'attached_at': '', 'detached_at': '', 'volume_id': '5085559b-47dd-4d62-b9bb-f36adda67b30', 'serial': '5085559b-47dd-4d62-b9bb-f36adda67b30'}, 'device_type': 'disk', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:42:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:42:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvFPSgem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:42:00 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:42:00 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:42:00 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f2fb4a-c506-417f-9e57-08c38fc470c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:42:00 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec083be-7839-499f-9d19-a28b6062917b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30] added
Aug 27 05:42:00 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f29da3-de51-43bd-bea2-b7d6312c9756]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[034ccadb-f1f3-4b9f-bf1a-a3ee1034b748]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvFPSgem {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QvFPSgem" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e43ad-c782-4497-a281-28fdbf4aef57]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QvFPSgem'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed20d9d-a83f-43af-af6a-4d5de4fea493]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b344d44b-6a79-4310-847f-c6060ee4f71e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:42:00 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:42:00 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:42:00 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[295c1c38-02c7-439a-8803-cb1141a468e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260]
Aug 27 05:42:01 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260] successful.
Aug 27 05:42:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7cff8e-a718-4e26-93e8-cfa6588655d9]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[695bfc55-6ec0-49d0-954d-9d1243918493]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:42:01 user nova-compute[72904]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 (non-flash)
Aug 27 05:42:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:42:01 user nova-compute[72904]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 (non-flash)
Aug 27 05:42:01 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc72cc1b-8b69-42ff-8075-f8a3c6d333e9]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:42:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvFPSgem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23339363034323562', 'path': '/dev/sdc'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339363034323562', 'path': '/dev/sdc'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-611961795',display_name='tempest-TestVolumeBootPattern-server-611961795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-611961795',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-vcmum2bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:41:42Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=d639ed42-e808-4722-a5dd-da5948cc26bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:50:b4,bridge_name='br-int',has_traffic_filtering=True,id=19a90ae3-03b3-41b0-8bfd-97e694575fb2,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a90ae3-03') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.objects.instance [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'pci_devices' on Instance uuid d639ed42-e808-4722-a5dd-da5948cc26bc {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:42:02 user nova-compute[72904]:   <uuid>d639ed42-e808-4722-a5dd-da5948cc26bc</uuid>
Aug 27 05:42:02 user nova-compute[72904]:   <name>instance-00000032</name>
Aug 27 05:42:02 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:42:02 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:42:02 user nova-compute[72904]:   <metadata>
Aug 27 05:42:02 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:42:02 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:42:02 user nova-compute[72904]:       <nova:name>tempest-TestVolumeBootPattern-server-611961795</nova:name>
Aug 27 05:42:02 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:42:00</nova:creationTime>
Aug 27 05:42:02 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:42:02 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:42:02 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:42:02 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:42:02 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:42:02 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:42:02 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:42:02 user nova-compute[72904]:       <nova:owner>
Aug 27 05:42:02 user nova-compute[72904]:         <nova:user uuid="75fd6f1e0a2843cca915e52045b78d4f">tempest-TestVolumeBootPattern-1154964358-project-member</nova:user>
Aug 27 05:42:02 user nova-compute[72904]:         <nova:project uuid="41729cc06fa94b569a46e971b769d96f">tempest-TestVolumeBootPattern-1154964358</nova:project>
Aug 27 05:42:02 user nova-compute[72904]:       </nova:owner>
Aug 27 05:42:02 user nova-compute[72904]:       <nova:ports>
Aug 27 05:42:02 user nova-compute[72904]:         <nova:port uuid="19a90ae3-03b3-41b0-8bfd-97e694575fb2">
Aug 27 05:42:02 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 27 05:42:02 user nova-compute[72904]:         </nova:port>
Aug 27 05:42:02 user nova-compute[72904]:       </nova:ports>
Aug 27 05:42:02 user nova-compute[72904]:     </nova:instance>
Aug 27 05:42:02 user nova-compute[72904]:   </metadata>
Aug 27 05:42:02 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:42:02 user nova-compute[72904]:     <system>
Aug 27 05:42:02 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:42:02 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:42:02 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:42:02 user nova-compute[72904]:       <entry name="serial">d639ed42-e808-4722-a5dd-da5948cc26bc</entry>
Aug 27 05:42:02 user nova-compute[72904]:       <entry name="uuid">d639ed42-e808-4722-a5dd-da5948cc26bc</entry>
Aug 27 05:42:02 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:42:02 user nova-compute[72904]:     </system>
Aug 27 05:42:02 user nova-compute[72904]:   </sysinfo>
Aug 27 05:42:02 user nova-compute[72904]:   <os>
Aug 27 05:42:02 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:42:02 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:42:02 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:42:02 user nova-compute[72904]:   </os>
Aug 27 05:42:02 user nova-compute[72904]:   <features>
Aug 27 05:42:02 user nova-compute[72904]:     <acpi/>
Aug 27 05:42:02 user nova-compute[72904]:     <apic/>
Aug 27 05:42:02 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:42:02 user nova-compute[72904]:   </features>
Aug 27 05:42:02 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:42:02 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:42:02 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:42:02 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:42:02 user nova-compute[72904]:   </clock>
Aug 27 05:42:02 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:42:02 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:42:02 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:42:02 user nova-compute[72904]:   </cpu>
Aug 27 05:42:02 user nova-compute[72904]:   <devices>
Aug 27 05:42:02 user nova-compute[72904]:     <disk type="block" device="disk">
Aug 27 05:42:02 user nova-compute[72904]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:42:02 user nova-compute[72904]:       <source dev="/dev/sdc"/>
Aug 27 05:42:02 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:42:02 user nova-compute[72904]:       <serial>5085559b-47dd-4d62-b9bb-f36adda67b30</serial>
Aug 27 05:42:02 user nova-compute[72904]:     </disk>
Aug 27 05:42:02 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:42:02 user nova-compute[72904]:       <mac address="fa:16:3e:d5:50:b4"/>
Aug 27 05:42:02 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:42:02 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:42:02 user nova-compute[72904]:       <target dev="tap19a90ae3-03"/>
Aug 27 05:42:02 user nova-compute[72904]:     </interface>
Aug 27 05:42:02 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:42:02 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/d639ed42-e808-4722-a5dd-da5948cc26bc/console.log" append="off"/>
Aug 27 05:42:02 user nova-compute[72904]:     </serial>
Aug 27 05:42:02 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:42:02 user nova-compute[72904]:     <video>
Aug 27 05:42:02 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:42:02 user nova-compute[72904]:     </video>
Aug 27 05:42:02 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:42:02 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:42:02 user nova-compute[72904]:     </rng>
Aug 27 05:42:02 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:42:02 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:42:02 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:42:02 user nova-compute[72904]:     </memballoon>
Aug 27 05:42:02 user nova-compute[72904]:   </devices>
Aug 27 05:42:02 user nova-compute[72904]: </domain>
Aug 27 05:42:02 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-611961795',display_name='tempest-TestVolumeBootPattern-server-611961795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-611961795',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-vcmum2bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:41:42Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=d639ed42-e808-4722-a5dd-da5948cc26bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:50:b4,bridge_name='br-int',has_traffic_filtering=True,id=19a90ae3-03b3-41b0-8bfd-97e694575fb2,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a90ae3-03') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG os_vif [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:50:b4,bridge_name='br-int',has_traffic_filtering=True,id=19a90ae3-03b3-41b0-8bfd-97e694575fb2,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a90ae3-03') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19a90ae3-03, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap19a90ae3-03, col_values=(('external_ids', {'iface-id': '19a90ae3-03b3-41b0-8bfd-97e694575fb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:50:b4', 'vm-uuid': 'd639ed42-e808-4722-a5dd-da5948cc26bc'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:02 user nova-compute[72904]: INFO os_vif [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:50:b4,bridge_name='br-int',has_traffic_filtering=True,id=19a90ae3-03b3-41b0-8bfd-97e694575fb2,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a90ae3-03')
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:42:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] No VIF found with MAC fa:16:3e:d5:50:b4, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Skipping network cache update for instance because it is Building. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-5ce3048e-0cb7-4cc4-add2-b2a9b41cf25a req-55d23b2a-b353-473c-855b-f2f40f5ce829 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5ce3048e-0cb7-4cc4-add2-b2a9b41cf25a req-55d23b2a-b353-473c-855b-f2f40f5ce829 service nova] Acquiring lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5ce3048e-0cb7-4cc4-add2-b2a9b41cf25a req-55d23b2a-b353-473c-855b-f2f40f5ce829 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-5ce3048e-0cb7-4cc4-add2-b2a9b41cf25a req-55d23b2a-b353-473c-855b-f2f40f5ce829 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG nova.compute.manager [req-5ce3048e-0cb7-4cc4-add2-b2a9b41cf25a req-55d23b2a-b353-473c-855b-f2f40f5ce829 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] No waiting events found dispatching network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:42:03 user nova-compute[72904]: WARNING nova.compute.manager [req-5ce3048e-0cb7-4cc4-add2-b2a9b41cf25a req-55d23b2a-b353-473c-855b-f2f40f5ce829 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received unexpected event network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 for instance with vm_state building and task_state spawning.
Aug 27 05:42:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:42:03 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid c486f7df-c440-455c-a152-f3a3a8d11140 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:42:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:42:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:42:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-81e7b8e0-0bab-4398-a025-86bc07968bd0 req-6832aaf3-c5bb-48e8-a008-70a9fbca2051 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81e7b8e0-0bab-4398-a025-86bc07968bd0 req-6832aaf3-c5bb-48e8-a008-70a9fbca2051 service nova] Acquiring lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81e7b8e0-0bab-4398-a025-86bc07968bd0 req-6832aaf3-c5bb-48e8-a008-70a9fbca2051 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-81e7b8e0-0bab-4398-a025-86bc07968bd0 req-6832aaf3-c5bb-48e8-a008-70a9fbca2051 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [req-81e7b8e0-0bab-4398-a025-86bc07968bd0 req-6832aaf3-c5bb-48e8-a008-70a9fbca2051 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] No waiting events found dispatching network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:42:05 user nova-compute[72904]: WARNING nova.compute.manager [req-81e7b8e0-0bab-4398-a025-86bc07968bd0 req-6832aaf3-c5bb-48e8-a008-70a9fbca2051 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received unexpected event network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 for instance with vm_state building and task_state spawning.
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114925.8074296, d639ed42-e808-4722-a5dd-da5948cc26bc => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:42:05 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] VM Resumed (Lifecycle Event)
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:42:05 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Instance spawned successfully.
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:42:05 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114925.809514, d639ed42-e808-4722-a5dd-da5948cc26bc => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:42:05 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] VM Started (Lifecycle Event)
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:42:05 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:42:05 user nova-compute[72904]: INFO nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Took 5.16 seconds to spawn the instance on the hypervisor.
Aug 27 05:42:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:42:06 user nova-compute[72904]: INFO nova.compute.manager [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Took 24.76 seconds to build instance.
Aug 27 05:42:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-49aeec76-50b8-4d88-96ae-34efa0b6fcd3 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.868s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:42:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:42:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:07 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:42:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:49 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:42:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:42:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:42:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:42:49 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:42:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:42:49 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:42:50 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:42:50 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8589MB free_disk=25.35564422607422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c486f7df-c440-455c-a152-f3a3a8d11140 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance d639ed42-e808-4722-a5dd-da5948cc26bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:42:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:42:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:42:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:42:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:43:00 user nova-compute[72904]: INFO nova.compute.claims [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Claim successful on node user
Aug 27 05:43:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:43:00 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:43:00 user nova-compute[72904]: DEBUG nova.policy [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53a78aa46042494bbaf866598102b0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea13632b964f2db9959ade37498fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:43:01 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Creating image(s)
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "/opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "/opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "/opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk 1073741824" returned: 0 in 0.054s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Cannot resize image /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Ensure instance console log exists: /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Successfully created port: 6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Successfully updated port: 6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquired lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-changed-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG nova.compute.manager [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Refreshing instance network info cache due to event network-changed-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] Acquiring lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:43:02 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updating instance_info_cache with network_info: [{"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Releasing lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Instance network_info: |[{"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] Acquired lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Refreshing network info cache for port 6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Start _get_guest_xml network_info=[{"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:43:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:43:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1178598133',display_name='tempest-VolumesSnapshotTestJSON-instance-1178598133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1178598133',id=51,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElgT3AkqKpI5Joa6JaeRgu0Q2yLswvALdcz03iEC33rtWTX4iYWX5XZ7ZVLj2Grmg3hUDdEp/+7pRGmq9BV+zB1lCRvgYBDGjFSYUJH9/g40OX0FbyKt8DItWSdtUJXXw==',key_name='tempest-keypair-1695573906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ea13632b964f2db9959ade37498fa2',ramdisk_id='',reservation_id='r-rfr6uez6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-894862436',owner_user_name='tempest-VolumesSnapshotTestJSON-894862436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a78aa46042494bbaf866598102b0ec',uuid=940e09e3-2384-4808-b8b6-aa6b7eb3a1ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converting VIF {"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f1:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbecdfe-ac') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.objects.instance [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'pci_devices' on Instance uuid 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:43:03 user nova-compute[72904]:   <uuid>940e09e3-2384-4808-b8b6-aa6b7eb3a1ec</uuid>
Aug 27 05:43:03 user nova-compute[72904]:   <name>instance-00000033</name>
Aug 27 05:43:03 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:43:03 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:43:03 user nova-compute[72904]:   <metadata>
Aug 27 05:43:03 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:43:03 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:43:03 user nova-compute[72904]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1178598133</nova:name>
Aug 27 05:43:03 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:43:03</nova:creationTime>
Aug 27 05:43:03 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:43:03 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:43:03 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:43:03 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:43:03 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:43:03 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:43:03 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:43:03 user nova-compute[72904]:       <nova:owner>
Aug 27 05:43:03 user nova-compute[72904]:         <nova:user uuid="53a78aa46042494bbaf866598102b0ec">tempest-VolumesSnapshotTestJSON-894862436-project-member</nova:user>
Aug 27 05:43:03 user nova-compute[72904]:         <nova:project uuid="33ea13632b964f2db9959ade37498fa2">tempest-VolumesSnapshotTestJSON-894862436</nova:project>
Aug 27 05:43:03 user nova-compute[72904]:       </nova:owner>
Aug 27 05:43:03 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:43:03 user nova-compute[72904]:       <nova:ports>
Aug 27 05:43:03 user nova-compute[72904]:         <nova:port uuid="6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a">
Aug 27 05:43:03 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 27 05:43:03 user nova-compute[72904]:         </nova:port>
Aug 27 05:43:03 user nova-compute[72904]:       </nova:ports>
Aug 27 05:43:03 user nova-compute[72904]:     </nova:instance>
Aug 27 05:43:03 user nova-compute[72904]:   </metadata>
Aug 27 05:43:03 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:43:03 user nova-compute[72904]:     <system>
Aug 27 05:43:03 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:43:03 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:43:03 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:43:03 user nova-compute[72904]:       <entry name="serial">940e09e3-2384-4808-b8b6-aa6b7eb3a1ec</entry>
Aug 27 05:43:03 user nova-compute[72904]:       <entry name="uuid">940e09e3-2384-4808-b8b6-aa6b7eb3a1ec</entry>
Aug 27 05:43:03 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:43:03 user nova-compute[72904]:     </system>
Aug 27 05:43:03 user nova-compute[72904]:   </sysinfo>
Aug 27 05:43:03 user nova-compute[72904]:   <os>
Aug 27 05:43:03 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:43:03 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:43:03 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:43:03 user nova-compute[72904]:   </os>
Aug 27 05:43:03 user nova-compute[72904]:   <features>
Aug 27 05:43:03 user nova-compute[72904]:     <acpi/>
Aug 27 05:43:03 user nova-compute[72904]:     <apic/>
Aug 27 05:43:03 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:43:03 user nova-compute[72904]:   </features>
Aug 27 05:43:03 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:43:03 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:43:03 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:43:03 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:43:03 user nova-compute[72904]:   </clock>
Aug 27 05:43:03 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:43:03 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:43:03 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:43:03 user nova-compute[72904]:   </cpu>
Aug 27 05:43:03 user nova-compute[72904]:   <devices>
Aug 27 05:43:03 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:43:03 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:43:03 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk"/>
Aug 27 05:43:03 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:43:03 user nova-compute[72904]:     </disk>
Aug 27 05:43:03 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:43:03 user nova-compute[72904]:       <mac address="fa:16:3e:7f:f1:b4"/>
Aug 27 05:43:03 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:43:03 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:43:03 user nova-compute[72904]:       <target dev="tap6cbecdfe-ac"/>
Aug 27 05:43:03 user nova-compute[72904]:     </interface>
Aug 27 05:43:03 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:43:03 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/console.log" append="off"/>
Aug 27 05:43:03 user nova-compute[72904]:     </serial>
Aug 27 05:43:03 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:43:03 user nova-compute[72904]:     <video>
Aug 27 05:43:03 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:43:03 user nova-compute[72904]:     </video>
Aug 27 05:43:03 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:43:03 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:43:03 user nova-compute[72904]:     </rng>
Aug 27 05:43:03 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:43:03 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:43:03 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:43:03 user nova-compute[72904]:     </memballoon>
Aug 27 05:43:03 user nova-compute[72904]:   </devices>
Aug 27 05:43:03 user nova-compute[72904]: </domain>
Aug 27 05:43:03 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1178598133',display_name='tempest-VolumesSnapshotTestJSON-instance-1178598133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1178598133',id=51,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElgT3AkqKpI5Joa6JaeRgu0Q2yLswvALdcz03iEC33rtWTX4iYWX5XZ7ZVLj2Grmg3hUDdEp/+7pRGmq9BV+zB1lCRvgYBDGjFSYUJH9/g40OX0FbyKt8DItWSdtUJXXw==',key_name='tempest-keypair-1695573906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ea13632b964f2db9959ade37498fa2',ramdisk_id='',reservation_id='r-rfr6uez6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-894862436',owner_user_name='tempest-VolumesSnapshotTestJSON-894862436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a78aa46042494bbaf866598102b0ec',uuid=940e09e3-2384-4808-b8b6-aa6b7eb3a1ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converting VIF {"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f1:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbecdfe-ac') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG os_vif [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f1:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbecdfe-ac') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cbecdfe-ac, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cbecdfe-ac, col_values=(('external_ids', {'iface-id': '6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:f1:b4', 'vm-uuid': '940e09e3-2384-4808-b8b6-aa6b7eb3a1ec'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:03 user nova-compute[72904]: INFO os_vif [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:f1:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbecdfe-ac')
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No VIF found with MAC fa:16:3e:7f:f1:b4, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updated VIF entry in instance network info cache for port 6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.neutron [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updating instance_info_cache with network_info: [{"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-7db749c3-3667-4a11-9971-02600ab3db57 req-35eda09c-1441-4bc2-a93b-233cb4a33ecd service nova] Releasing lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Skipping network cache update for instance because it is Building. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:43:03 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid c486f7df-c440-455c-a152-f3a3a8d11140 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-ea505a24-97df-47c6-9a31-4986dce1f48a req-30f5d304-e088-4997-9d82-d897098e4bc1 service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea505a24-97df-47c6-9a31-4986dce1f48a req-30f5d304-e088-4997-9d82-d897098e4bc1 service nova] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea505a24-97df-47c6-9a31-4986dce1f48a req-30f5d304-e088-4997-9d82-d897098e4bc1 service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea505a24-97df-47c6-9a31-4986dce1f48a req-30f5d304-e088-4997-9d82-d897098e4bc1 service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:04 user nova-compute[72904]: DEBUG nova.compute.manager [req-ea505a24-97df-47c6-9a31-4986dce1f48a req-30f5d304-e088-4997-9d82-d897098e4bc1 service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] No waiting events found dispatching network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:43:04 user nova-compute[72904]: WARNING nova.compute.manager [req-ea505a24-97df-47c6-9a31-4986dce1f48a req-30f5d304-e088-4997-9d82-d897098e4bc1 service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received unexpected event network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a for instance with vm_state building and task_state spawning.
Aug 27 05:43:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114986.8868103, 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:43:06 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] VM Resumed (Lifecycle Event)
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:43:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Instance spawned successfully.
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-9a122aed-c965-4f1c-8e33-2ae5d6365c65 req-18c39770-feff-46b8-b983-abfbcd685a3d service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9a122aed-c965-4f1c-8e33-2ae5d6365c65 req-18c39770-feff-46b8-b983-abfbcd685a3d service nova] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9a122aed-c965-4f1c-8e33-2ae5d6365c65 req-18c39770-feff-46b8-b983-abfbcd685a3d service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9a122aed-c965-4f1c-8e33-2ae5d6365c65 req-18c39770-feff-46b8-b983-abfbcd685a3d service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-9a122aed-c965-4f1c-8e33-2ae5d6365c65 req-18c39770-feff-46b8-b983-abfbcd685a3d service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] No waiting events found dispatching network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:43:06 user nova-compute[72904]: WARNING nova.compute.manager [req-9a122aed-c965-4f1c-8e33-2ae5d6365c65 req-18c39770-feff-46b8-b983-abfbcd685a3d service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received unexpected event network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a for instance with vm_state building and task_state spawning.
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:43:06 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693114986.8875434, 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:43:06 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] VM Started (Lifecycle Event)
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:43:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:43:07 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:43:07 user nova-compute[72904]: INFO nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 27 05:43:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:43:07 user nova-compute[72904]: INFO nova.compute.manager [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Took 6.57 seconds to build instance.
Aug 27 05:43:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-7ef38643-b30f-4f3b-a182-3f0f047d69ff tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.669s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:43:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:43:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:43:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:43:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:43:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-changed-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:33 user nova-compute[72904]: DEBUG nova.compute.manager [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Refreshing instance network info cache due to event network-changed-19a90ae3-03b3-41b0-8bfd-97e694575fb2. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:43:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] Acquiring lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:43:33 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] Acquired lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:43:33 user nova-compute[72904]: DEBUG nova.network.neutron [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Refreshing network info cache for port 19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:43:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updated VIF entry in instance network info cache for port 19a90ae3-03b3-41b0-8bfd-97e694575fb2. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:43:34 user nova-compute[72904]: DEBUG nova.network.neutron [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updating instance_info_cache with network_info: [{"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:43:34 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-112806cd-9972-4371-993c-88fa9d9ba420 req-019464e1-4f7f-451a-9076-8fe4efa01e95 service nova] Releasing lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-changed-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG nova.compute.manager [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Refreshing instance network info cache due to event network-changed-19a90ae3-03b3-41b0-8bfd-97e694575fb2. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] Acquiring lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] Acquired lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG nova.network.neutron [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Refreshing network info cache for port 19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "d639ed42-e808-4722-a5dd-da5948cc26bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:35 user nova-compute[72904]: INFO nova.compute.manager [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Terminating instance
Aug 27 05:43:35 user nova-compute[72904]: DEBUG nova.compute.manager [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updated VIF entry in instance network info cache for port 19a90ae3-03b3-41b0-8bfd-97e694575fb2. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.network.neutron [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updating instance_info_cache with network_info: [{"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a65bebdc-c2d4-4d9f-a553-e8c1649e38f5 req-6c38f8d7-5f89-471e-8d5b-fe28bd629dcf service nova] Releasing lock "refresh_cache-d639ed42-e808-4722-a5dd-da5948cc26bc" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-ea2ae622-2714-4b47-919d-c81eebb0a349 req-c482a3e8-eff6-4d98-9db2-a22cbd4fc502 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-vif-unplugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea2ae622-2714-4b47-919d-c81eebb0a349 req-c482a3e8-eff6-4d98-9db2-a22cbd4fc502 service nova] Acquiring lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea2ae622-2714-4b47-919d-c81eebb0a349 req-c482a3e8-eff6-4d98-9db2-a22cbd4fc502 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-ea2ae622-2714-4b47-919d-c81eebb0a349 req-c482a3e8-eff6-4d98-9db2-a22cbd4fc502 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-ea2ae622-2714-4b47-919d-c81eebb0a349 req-c482a3e8-eff6-4d98-9db2-a22cbd4fc502 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] No waiting events found dispatching network-vif-unplugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.compute.manager [req-ea2ae622-2714-4b47-919d-c81eebb0a349 req-c482a3e8-eff6-4d98-9db2-a22cbd4fc502 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-vif-unplugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:43:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Instance destroyed successfully.
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.objects.instance [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'resources' on Instance uuid d639ed42-e808-4722-a5dd-da5948cc26bc {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:41:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-611961795',display_name='tempest-TestVolumeBootPattern-server-611961795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-611961795',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:42:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-vcmum2bm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:42:06Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=d639ed42-e808-4722-a5dd-da5948cc26bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "address": "fa:16:3e:d5:50:b4", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a90ae3-03", "ovs_interfaceid": "19a90ae3-03b3-41b0-8bfd-97e694575fb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:50:b4,bridge_name='br-int',has_traffic_filtering=True,id=19a90ae3-03b3-41b0-8bfd-97e694575fb2,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a90ae3-03') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_vif [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:50:b4,bridge_name='br-int',has_traffic_filtering=True,id=19a90ae3-03b3-41b0-8bfd-97e694575fb2,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a90ae3-03') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19a90ae3-03, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:43:36 user nova-compute[72904]: INFO os_vif [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:50:b4,bridge_name='br-int',has_traffic_filtering=True,id=19a90ae3-03b3-41b0-8bfd-97e694575fb2,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a90ae3-03')
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QvFPSgem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:43:36 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c9ef0f-a68e-49cd-93c5-6aa641f9596d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc446a5d-969c-48cc-9519-5e847551a7d6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:43:36 user nova-compute[72904]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 (non-flash)
Aug 27 05:43:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:43:36 user nova-compute[72904]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 (non-flash)
Aug 27 05:43:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c63ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30'): ({'sdc'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Removing single pathed devices sdc {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9964e5-ed8e-4a67-98b5-91634df07767]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a39887-e89f-4958-9aac-c15a10a5d1b9]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flushing IO for device /dev/sdc {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87caa63-bfa6-4de1-937e-e20ef31c99a8]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a52c4-4c92-4d01-89c6-2cc3a69e15d2]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] SCSI volumes sdc have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b6a8c626', '/dev/disk/by-id/scsi-23339363034323562', '/dev/disk/by-id/scsi-1SCST_BIOb6a8c626-3960425b3a0f4751') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cc2c0d-7055-485c-91d3-07f02ebcb5e2]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a296ac54-ae92-41cf-9dba-b95c5201b627]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d8e668-9ad3-4ba1-9159-31d2a8e357ed]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260]
Aug 27 05:43:36 user nova-compute[72904]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30, portal: 172.16.0.220,3260] successful.
Aug 27 05:43:36 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5085559b-47dd-4d62-b9bb-f36adda67b30 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8014793-9ca8-4081-9d20-aec9b2541cb5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== disconnect_volume: return (275ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:43:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Deleting instance files /opt/stack/data/nova/instances/d639ed42-e808-4722-a5dd-da5948cc26bc_del
Aug 27 05:43:36 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Deletion of /opt/stack/data/nova/instances/d639ed42-e808-4722-a5dd-da5948cc26bc_del complete
Aug 27 05:43:36 user nova-compute[72904]: INFO nova.compute.manager [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 27 05:43:36 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:43:36 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:43:37 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:43:37 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Took 0.49 seconds to deallocate network for instance.
Aug 27 05:43:37 user nova-compute[72904]: DEBUG nova.compute.manager [req-ffa6874a-344b-4219-b7e6-204ea704e1b0 req-a597f2d7-6b36-40f0-b85c-3893596671bf service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-vif-deleted-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:38 user nova-compute[72904]: INFO nova.compute.manager [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Took 0.78 seconds to detach 1 volumes for instance.
Aug 27 05:43:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-70d5feea-b4a5-4f0e-a1bb-fce055dd3c09 req-93e6b5be-e774-4d49-9015-5884fecd8de4 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received event network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-70d5feea-b4a5-4f0e-a1bb-fce055dd3c09 req-93e6b5be-e774-4d49-9015-5884fecd8de4 service nova] Acquiring lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-70d5feea-b4a5-4f0e-a1bb-fce055dd3c09 req-93e6b5be-e774-4d49-9015-5884fecd8de4 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-70d5feea-b4a5-4f0e-a1bb-fce055dd3c09 req-93e6b5be-e774-4d49-9015-5884fecd8de4 service nova] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG nova.compute.manager [req-70d5feea-b4a5-4f0e-a1bb-fce055dd3c09 req-93e6b5be-e774-4d49-9015-5884fecd8de4 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] No waiting events found dispatching network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:43:38 user nova-compute[72904]: WARNING nova.compute.manager [req-70d5feea-b4a5-4f0e-a1bb-fce055dd3c09 req-93e6b5be-e774-4d49-9015-5884fecd8de4 service nova] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Received unexpected event network-vif-plugged-19a90ae3-03b3-41b0-8bfd-97e694575fb2 for instance with vm_state deleted and task_state None.
Aug 27 05:43:38 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:43:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:38 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Deleted allocations for instance d639ed42-e808-4722-a5dd-da5948cc26bc
Aug 27 05:43:38 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-54c13931-a009-408a-a5e5-fb92542c5d57 tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "d639ed42-e808-4722-a5dd-da5948cc26bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:43:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693115016.4822578, d639ed42-e808-4722-a5dd-da5948cc26bc => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:43:51 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] VM Stopped (Lifecycle Event)
Aug 27 05:43:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a24bb4a5-e6ed-472f-8093-60cc65476815 None None] [instance: d639ed42-e808-4722-a5dd-da5948cc26bc] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:51 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:43:52 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:43:52 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8611MB free_disk=25.325603485107422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance c486f7df-c440-455c-a152-f3a3a8d11140 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:43:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:43:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:43:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:44:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:44:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:44:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:44:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:44:07 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:11 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:44:16 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:31 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-changed-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Refreshing instance network info cache due to event network-changed-e8866ba5-477e-4a58-9e11-1d0382910cf9. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] Acquiring lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] Acquired lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Refreshing network info cache for port e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "c486f7df-c440-455c-a152-f3a3a8d11140" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "c486f7df-c440-455c-a152-f3a3a8d11140" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:47 user nova-compute[72904]: INFO nova.compute.manager [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Terminating instance
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.compute.manager [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-781e0462-9b74-47ae-a240-14dd29147402 req-b38e51fc-4ebb-41d0-8692-53acebf1accd service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-vif-unplugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-781e0462-9b74-47ae-a240-14dd29147402 req-b38e51fc-4ebb-41d0-8692-53acebf1accd service nova] Acquiring lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-781e0462-9b74-47ae-a240-14dd29147402 req-b38e51fc-4ebb-41d0-8692-53acebf1accd service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-781e0462-9b74-47ae-a240-14dd29147402 req-b38e51fc-4ebb-41d0-8692-53acebf1accd service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-781e0462-9b74-47ae-a240-14dd29147402 req-b38e51fc-4ebb-41d0-8692-53acebf1accd service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] No waiting events found dispatching network-vif-unplugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.compute.manager [req-781e0462-9b74-47ae-a240-14dd29147402 req-b38e51fc-4ebb-41d0-8692-53acebf1accd service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-vif-unplugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updated VIF entry in instance network info cache for port e8866ba5-477e-4a58-9e11-1d0382910cf9. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.network.neutron [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [{"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-d549e6cc-0646-42fa-b35d-c9602be9093b req-c93147b4-14a9-4d75-a1aa-1f1939add605 service nova] Releasing lock "refresh_cache-c486f7df-c440-455c-a152-f3a3a8d11140" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:44:47 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Instance destroyed successfully.
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.objects.instance [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lazy-loading 'resources' on Instance uuid c486f7df-c440-455c-a152-f3a3a8d11140 {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-418353364',display_name='tempest-TestVolumeBootPattern-server-418353364',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-418353364',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApWbHwqawJMD0GQLogZUmP212ZPJPVzq9EvIdtXxq2WeIyh5LP9MyLY/rtPpOP1huhmbci7ldFsCAQQ+upEkqtmZ6XfkTm+1CNnuRjGLpnBgMeDX5A7860ZV9/Fbk/tww==',key_name='tempest-TestVolumeBootPattern-1336161678',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41729cc06fa94b569a46e971b769d96f',ramdisk_id='',reservation_id='r-viipatq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1154964358',owner_user_name='tempest-TestVolumeBootPattern-1154964358-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:39:47Z,user_data=None,user_id='75fd6f1e0a2843cca915e52045b78d4f',uuid=c486f7df-c440-455c-a152-f3a3a8d11140,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converting VIF {"id": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "address": "fa:16:3e:d0:1f:01", "network": {"id": "924311e6-da36-4c8d-8539-8f81e1e7ac50", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1606586442-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41729cc06fa94b569a46e971b769d96f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8866ba5-47", "ovs_interfaceid": "e8866ba5-477e-4a58-9e11-1d0382910cf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:1f:01,bridge_name='br-int',has_traffic_filtering=True,id=e8866ba5-477e-4a58-9e11-1d0382910cf9,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8866ba5-47') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG os_vif [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:1f:01,bridge_name='br-int',has_traffic_filtering=True,id=e8866ba5-477e-4a58-9e11-1d0382910cf9,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8866ba5-47') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8866ba5-47, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:47 user nova-compute[72904]: INFO os_vif [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:1f:01,bridge_name='br-int',has_traffic_filtering=True,id=e8866ba5-477e-4a58-9e11-1d0382910cf9,network=Network(924311e6-da36-4c8d-8539-8f81e1e7ac50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8866ba5-47')
Aug 27 05:44:47 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AkLzpYcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:44:47 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:44:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:44:47 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[109f378a-1d2b-4a5d-beb9-bd55eb9a8937]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa83c19-35ba-4ba3-9c86-64d56fc541e0]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:44:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc (non-flash)
Aug 27 05:44:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c7de200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8981f3-2f1f-4124-8797-fdfb2f5ef104]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8feb4e80-0dac-4a4b-82b1-4530d3440da1]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb82af1b-2942-495c-bb63-37c078b466e5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba095c9c-7bed-449f-91b4-29a750307217]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO99bcd251-e697f8351da058ba', '/dev/disk/by-id/scsi-26536393766383335', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_99bcd251') {{(pid=84216) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3ba6fe-f8b0-42dc-bf95-b0cfcbc31eb2]: (4, None) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[11db7935-3c72-40db-bf2e-d832311fd7dd]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bfd339-dfc7-4d03-9ed4-0a9b14ea44d3]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260]
Aug 27 05:44:48 user nova-compute[72904]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc, portal: 172.16.0.220,3260] successful.
Aug 27 05:44:48 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90895414-f1f1-41d2-9430-b822156430fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2662f694-e75a-437b-89eb-0760880c47c2]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] <== disconnect_volume: return (265ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:44:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Deleting instance files /opt/stack/data/nova/instances/c486f7df-c440-455c-a152-f3a3a8d11140_del
Aug 27 05:44:48 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Deletion of /opt/stack/data/nova/instances/c486f7df-c440-455c-a152-f3a3a8d11140_del complete
Aug 27 05:44:48 user nova-compute[72904]: INFO nova.compute.manager [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 27 05:44:48 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:44:48 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:44:48 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Took 0.48 seconds to deallocate network for instance.
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-88d99996-df6b-498d-843c-509075525fd2 req-d495f8a3-e7fd-4882-a451-965bc5926ad0 service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-vif-deleted-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:44:49 user nova-compute[72904]: INFO nova.compute.manager [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Took 0.78 seconds to detach 1 volumes for instance.
Aug 27 05:44:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-46544452-aa8e-4b99-bd21-8f7f11d79f9a req-7237d530-1a39-43ac-bd13-a4c27f562e1a service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received event network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-46544452-aa8e-4b99-bd21-8f7f11d79f9a req-7237d530-1a39-43ac-bd13-a4c27f562e1a service nova] Acquiring lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-46544452-aa8e-4b99-bd21-8f7f11d79f9a req-7237d530-1a39-43ac-bd13-a4c27f562e1a service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-46544452-aa8e-4b99-bd21-8f7f11d79f9a req-7237d530-1a39-43ac-bd13-a4c27f562e1a service nova] Lock "c486f7df-c440-455c-a152-f3a3a8d11140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.compute.manager [req-46544452-aa8e-4b99-bd21-8f7f11d79f9a req-7237d530-1a39-43ac-bd13-a4c27f562e1a service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] No waiting events found dispatching network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:44:49 user nova-compute[72904]: WARNING nova.compute.manager [req-46544452-aa8e-4b99-bd21-8f7f11d79f9a req-7237d530-1a39-43ac-bd13-a4c27f562e1a service nova] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Received unexpected event network-vif-plugged-e8866ba5-477e-4a58-9e11-1d0382910cf9 for instance with vm_state deleted and task_state None.
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:44:49 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:44:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:50 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Deleted allocations for instance c486f7df-c440-455c-a152-f3a3a8d11140
Aug 27 05:44:50 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-97f2c1cf-2cff-4503-a212-9603cdd9d9de tempest-TestVolumeBootPattern-1154964358 tempest-TestVolumeBootPattern-1154964358-project-member] Lock "c486f7df-c440-455c-a152-f3a3a8d11140" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-changed-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:44:51 user nova-compute[72904]: DEBUG nova.compute.manager [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Refreshing instance network info cache due to event network-changed-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:44:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] Acquiring lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:44:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] Acquired lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:44:51 user nova-compute[72904]: DEBUG nova.network.neutron [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Refreshing network info cache for port 6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updated VIF entry in instance network info cache for port 6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG nova.network.neutron [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updating instance_info_cache with network_info: [{"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-a1a51de7-e705-4d0b-acfa-8111ff216f31 req-20b34c8f-545b-451a-9f0a-29447815ac8e service nova] Releasing lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG nova.objects.instance [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'flavor' on Instance uuid 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:44:52 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Ignoring supplied device name: /dev/vdb
Aug 27 05:44:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:53 user nova-compute[72904]: INFO nova.compute.manager [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Attaching volume af10df54-964c-4b6f-a2dd-acb7d322cac1 to /dev/vdb
Aug 27 05:44:53 user nova-compute[72904]: DEBUG os_brick.utils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3362cf0-d601-42a4-a9b5-ef21b5e97210]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7797f18a-2312-41aa-b384-324bb8179a1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3fdf6e-8501-4f1d-973c-02e10b44d059]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb404ee-4189-4fdd-81ab-b4f13522efe7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:44:53 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5997bf61-1523-49c7-adff-d8b284ee6708]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG os_brick.utils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updating existing volume attachment record: eec1f56e-baed-4382-afd9-fd1dc2badc02 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:44:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:44:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:44:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=25.324485778808594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:44:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:44:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:44:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:44:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:00 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:00 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:45:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:02 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693115087.9478304, c486f7df-c440-455c-a152-f3a3a8d11140 => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:45:02 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] VM Stopped (Lifecycle Event)
Aug 27 05:45:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e1174410-406d-4bda-9aa3-e410e8cda25b None None] [instance: c486f7df-c440-455c-a152-f3a3a8d11140] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:45:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIedHDJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:45:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:45:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:45:03 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f33041-01f2-403d-bbf1-4f4226822900]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:45:03 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e0349e-238b-4295-99d8-ec91c50dd49a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1] added
Aug 27 05:45:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d708a5-5686-4108-9584-8cbec48af6a0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d160f079-2f54-487a-bea4-28bde386d585]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIedHDJK {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIedHDJK" returned: 0 in 0.126s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[62003f71-628c-4c66-9773-4fdc2f9b8e7a]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oIedHDJK'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b53426-00d2-4427-aadf-2293b47e6f88]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fede3e-a621-4f14-83aa-7fa40295fd37]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:45:03 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:45:03 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:45:03 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:45:03 user nova-compute[72904]: 
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd8e5a5-04c5-4a8d-aafa-8d4e73cb9fd9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260]
Aug 27 05:45:03 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260] successful.
Aug 27 05:45:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[114e2d0e-c1f7-4f1d-9ee0-65cbecaaeca1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[11efa934-e034-402a-bd59-299a50db814a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 (non-flash)
Aug 27 05:45:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 (non-flash)
Aug 27 05:45:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28b2420-ec60-4c69-8275-2eaf44ac1807]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:45:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIedHDJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:45:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:45:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23735613864343334', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:45:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735613864343334', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:45:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'flavor' on Instance uuid 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:45:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:45:04 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:45:04 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:45:04 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:45:04 user nova-compute[72904]:   <serial>af10df54-964c-4b6f-a2dd-acb7d322cac1</serial>
Aug 27 05:45:04 user nova-compute[72904]: </disk>
Aug 27 05:45:04 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No VIF found with MAC fa:16:3e:7f:f1:b4, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-835ad60c-fd04-4bda-8357-8ca5b334e361 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.670s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:45:05 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:45:06 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updating instance_info_cache with network_info: [{"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:45:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:45:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:45:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:09 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:45:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:45:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:45:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:45:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:45:22 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:45:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:45:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:45:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:45:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:45:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:39 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:39 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:45:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:49 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:53 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:45:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:45:54 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.322677612304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:45:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:55 user nova-compute[72904]: INFO nova.compute.manager [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Detaching volume af10df54-964c-4b6f-a2dd-acb7d322cac1
Aug 27 05:45:55 user nova-compute[72904]: INFO nova.virt.block_device [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Attempting to driver detach volume af10df54-964c-4b6f-a2dd-acb7d322cac1 from mountpoint /dev/vdb
Aug 27 05:45:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Attempting to detach device vdb from instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:45:55 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:45:55 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:45:55 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:45:55 user nova-compute[72904]:   <serial>af10df54-964c-4b6f-a2dd-acb7d322cac1</serial>
Aug 27 05:45:55 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:45:55 user nova-compute[72904]: </disk>
Aug 27 05:45:55 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:45:55 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully detached device vdb from instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec from the persistent domain config.
Aug 27 05:45:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:45:55 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:45:55 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:45:55 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:45:55 user nova-compute[72904]:   <serial>af10df54-964c-4b6f-a2dd-acb7d322cac1</serial>
Aug 27 05:45:55 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:45:55 user nova-compute[72904]: </disk>
Aug 27 05:45:55 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693115155.8727193, 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:45:55 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully detached device vdb from instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec from the live domain config.
Aug 27 05:45:55 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIedHDJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:45:55 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf41bd6e-01aa-4c60-b04b-29d0761b9b4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95cac84-b89b-42b2-82b2-3f63ae0ace45]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 (non-flash)
Aug 27 05:45:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 (non-flash)
Aug 27 05:45:55 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919438c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fc30ce-4edd-4f01-b4be-c7ac5a9a42a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d993e-c220-4735-bcab-69a95f157398]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:45:55 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d605b088-7f64-45c2-8f19-a5bfcf43df79]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[099b8231-f8e6-4876-8614-54912e3c412b]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa5628-a223-400f-90b0-45cc46d842fc]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d064fd4-8ee6-4e2e-a946-faf400c9971d]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260]
Aug 27 05:45:56 user nova-compute[72904]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1, portal: 172.16.0.220,3260] successful.
Aug 27 05:45:56 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0075392e-5472-498b-965b-fd762cfd99ae]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== disconnect_volume: return (271ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG nova.objects.instance [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'flavor' on Instance uuid 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-3c6274de-005a-42a7-b485-616266f9027d tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.517s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:56 user nova-compute[72904]: INFO nova.compute.manager [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Terminating instance
Aug 27 05:45:56 user nova-compute[72904]: DEBUG nova.compute.manager [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-cb3b2618-93f0-48dc-9972-8fda9d01b8ba req-30ad813f-5c9a-4583-b06c-1049490c406b service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-vif-unplugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cb3b2618-93f0-48dc-9972-8fda9d01b8ba req-30ad813f-5c9a-4583-b06c-1049490c406b service nova] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cb3b2618-93f0-48dc-9972-8fda9d01b8ba req-30ad813f-5c9a-4583-b06c-1049490c406b service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-cb3b2618-93f0-48dc-9972-8fda9d01b8ba req-30ad813f-5c9a-4583-b06c-1049490c406b service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-cb3b2618-93f0-48dc-9972-8fda9d01b8ba req-30ad813f-5c9a-4583-b06c-1049490c406b service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] No waiting events found dispatching network-vif-unplugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.compute.manager [req-cb3b2618-93f0-48dc-9972-8fda9d01b8ba req-30ad813f-5c9a-4583-b06c-1049490c406b service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-vif-unplugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:45:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Instance destroyed successfully.
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.objects.instance [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'resources' on Instance uuid 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:42:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1178598133',display_name='tempest-VolumesSnapshotTestJSON-instance-1178598133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1178598133',id=51,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElgT3AkqKpI5Joa6JaeRgu0Q2yLswvALdcz03iEC33rtWTX4iYWX5XZ7ZVLj2Grmg3hUDdEp/+7pRGmq9BV+zB1lCRvgYBDGjFSYUJH9/g40OX0FbyKt8DItWSdtUJXXw==',key_name='tempest-keypair-1695573906',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:43:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33ea13632b964f2db9959ade37498fa2',ramdisk_id='',reservation_id='r-rfr6uez6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-894862436',owner_user_name='tempest-VolumesSnapshotTestJSON-894862436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a78aa46042494bbaf866598102b0ec',uuid=940e09e3-2384-4808-b8b6-aa6b7eb3a1ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converting VIF {"id": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "address": "fa:16:3e:7f:f1:b4", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbecdfe-ac", "ovs_interfaceid": "6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f1:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbecdfe-ac') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_vif [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f1:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbecdfe-ac') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cbecdfe-ac, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:45:57 user nova-compute[72904]: INFO os_vif [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:f1:b4,bridge_name='br-int',has_traffic_filtering=True,id=6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbecdfe-ac')
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIedHDJK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:45:57 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af10df54-964c-4b6f-a2dd-acb7d322cac1', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fcfd25-f154-443d-8a12-71ae2202e548]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:57 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 27 05:45:57 user nova-compute[72904]: 
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0faeb8-1faf-4236-9ca5-20d9be352215]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:45:57 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:45:57 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:45:57 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:45:57 user nova-compute[72904]: 
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c4e2710>, {}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Disconnecting from: [] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== disconnect_volume: return (53ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:45:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Deleting instance files /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec_del
Aug 27 05:45:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Deletion of /opt/stack/data/nova/instances/940e09e3-2384-4808-b8b6-aa6b7eb3a1ec_del complete
Aug 27 05:45:57 user nova-compute[72904]: INFO nova.compute.manager [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 27 05:45:57 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:45:57 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:45:59 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Took 1.26 seconds to deallocate network for instance.
Aug 27 05:45:59 user nova-compute[72904]: WARNING nova.volume.cinder [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Attachment eec1f56e-baed-4382-afd9-fd1dc2badc02 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = eec1f56e-baed-4382-afd9-fd1dc2badc02. (HTTP 404) (Request-ID: req-00219ec2-ffe0-401f-9da6-998a825e691d)
Aug 27 05:45:59 user nova-compute[72904]: INFO nova.compute.manager [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Took 0.05 seconds to detach 1 volumes for instance.
Aug 27 05:45:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-e9de773c-c534-4f67-b583-d85adc9eaebf req-7c865cf3-b8e0-4e22-a9c6-0bcabdb3443d service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e9de773c-c534-4f67-b583-d85adc9eaebf req-7c865cf3-b8e0-4e22-a9c6-0bcabdb3443d service nova] Acquiring lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e9de773c-c534-4f67-b583-d85adc9eaebf req-7c865cf3-b8e0-4e22-a9c6-0bcabdb3443d service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e9de773c-c534-4f67-b583-d85adc9eaebf req-7c865cf3-b8e0-4e22-a9c6-0bcabdb3443d service nova] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-e9de773c-c534-4f67-b583-d85adc9eaebf req-7c865cf3-b8e0-4e22-a9c6-0bcabdb3443d service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] No waiting events found dispatching network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:45:59 user nova-compute[72904]: WARNING nova.compute.manager [req-e9de773c-c534-4f67-b583-d85adc9eaebf req-7c865cf3-b8e0-4e22-a9c6-0bcabdb3443d service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received unexpected event network-vif-plugged-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a for instance with vm_state active and task_state deleting.
Aug 27 05:45:59 user nova-compute[72904]: DEBUG nova.compute.manager [req-e9de773c-c534-4f67-b583-d85adc9eaebf req-7c865cf3-b8e0-4e22-a9c6-0bcabdb3443d service nova] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Received event network-vif-deleted-6cbecdfe-ac0f-4f65-9166-4e361bdc5f1a {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:45:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:45:59 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Deleted allocations for instance 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec
Aug 27 05:45:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-33451c15-13e1-4f97-b51c-a8e38f68ba01 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "940e09e3-2384-4808-b8b6-aa6b7eb3a1ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.655s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:46:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:46:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:46:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:46:06 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:46:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:46:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:46:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:12 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693115157.7182674, 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:46:12 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] VM Stopped (Lifecycle Event)
Aug 27 05:46:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-2a1c9864-ee55-46ff-9127-83d1cecc3287 None None] [instance: 940e09e3-2384-4808-b8b6-aa6b7eb3a1ec] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:46:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:46:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:46:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:46:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:46:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:46:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:46:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:46:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:46:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:46:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:46:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:46:54 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:46:54 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:46:55 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:46:55 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:46:55 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.34851837158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:46:55 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:46:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:46:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:47:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:47:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:47:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:47:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:47:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:47:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:47:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:21 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:47:23 user nova-compute[72904]: INFO nova.compute.claims [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Claim successful on node user
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:47:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.policy [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53a78aa46042494bbaf866598102b0ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33ea13632b964f2db9959ade37498fa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:47:23 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Creating image(s)
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "/opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "/opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "/opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.180s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk 1073741824" returned: 0 in 0.064s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Successfully created port: 05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Cannot resize image /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Ensure instance console log exists: /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:24 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Successfully updated port: 05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquired lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-changed-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.compute.manager [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Refreshing instance network info cache due to event network-changed-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] Acquiring lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.neutron [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating instance_info_cache with network_info: [{"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Releasing lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Instance network_info: |[{"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] Acquired lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.neutron [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Refreshing network info cache for port 05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Start _get_guest_xml network_info=[{"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:47:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:47:25 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1408472050',display_name='tempest-VolumesSnapshotTestJSON-instance-1408472050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1408472050',id=52,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMA5uX38RAbRYCxHNXWRzRnMXweQ6xEcLOHjoCGDZ0wTVT3suqJTMVUVHoHg3th8VLmt1XgYzvIrVFoWebfylMGWDLsSByswCuWnHfyuDst+wu5zP3H2Zd9zY+7m92508w==',key_name='tempest-keypair-1901324654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ea13632b964f2db9959ade37498fa2',ramdisk_id='',reservation_id='r-p13l5qi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-894862436',owner_user_name='tempest-VolumesSnapshotTestJSON-894862436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a78aa46042494bbaf866598102b0ec',uuid=6be48d30-3e77-47ba-8be8-a782a1c3f2ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converting VIF {"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ce2673-4b') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'pci_devices' on Instance uuid 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:47:25 user nova-compute[72904]:   <uuid>6be48d30-3e77-47ba-8be8-a782a1c3f2ff</uuid>
Aug 27 05:47:25 user nova-compute[72904]:   <name>instance-00000034</name>
Aug 27 05:47:25 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:47:25 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:47:25 user nova-compute[72904]:   <metadata>
Aug 27 05:47:25 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:47:25 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:47:25 user nova-compute[72904]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1408472050</nova:name>
Aug 27 05:47:25 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:47:25</nova:creationTime>
Aug 27 05:47:25 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:47:25 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:47:25 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:47:25 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:47:25 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:47:25 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:47:25 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:47:25 user nova-compute[72904]:       <nova:owner>
Aug 27 05:47:25 user nova-compute[72904]:         <nova:user uuid="53a78aa46042494bbaf866598102b0ec">tempest-VolumesSnapshotTestJSON-894862436-project-member</nova:user>
Aug 27 05:47:25 user nova-compute[72904]:         <nova:project uuid="33ea13632b964f2db9959ade37498fa2">tempest-VolumesSnapshotTestJSON-894862436</nova:project>
Aug 27 05:47:25 user nova-compute[72904]:       </nova:owner>
Aug 27 05:47:25 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:47:25 user nova-compute[72904]:       <nova:ports>
Aug 27 05:47:25 user nova-compute[72904]:         <nova:port uuid="05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d">
Aug 27 05:47:25 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 27 05:47:25 user nova-compute[72904]:         </nova:port>
Aug 27 05:47:25 user nova-compute[72904]:       </nova:ports>
Aug 27 05:47:25 user nova-compute[72904]:     </nova:instance>
Aug 27 05:47:25 user nova-compute[72904]:   </metadata>
Aug 27 05:47:25 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:47:25 user nova-compute[72904]:     <system>
Aug 27 05:47:25 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:47:25 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:47:25 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:47:25 user nova-compute[72904]:       <entry name="serial">6be48d30-3e77-47ba-8be8-a782a1c3f2ff</entry>
Aug 27 05:47:25 user nova-compute[72904]:       <entry name="uuid">6be48d30-3e77-47ba-8be8-a782a1c3f2ff</entry>
Aug 27 05:47:25 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:47:25 user nova-compute[72904]:     </system>
Aug 27 05:47:25 user nova-compute[72904]:   </sysinfo>
Aug 27 05:47:25 user nova-compute[72904]:   <os>
Aug 27 05:47:25 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:47:25 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:47:25 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:47:25 user nova-compute[72904]:   </os>
Aug 27 05:47:25 user nova-compute[72904]:   <features>
Aug 27 05:47:25 user nova-compute[72904]:     <acpi/>
Aug 27 05:47:25 user nova-compute[72904]:     <apic/>
Aug 27 05:47:25 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:47:25 user nova-compute[72904]:   </features>
Aug 27 05:47:25 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:47:25 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:47:25 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:47:25 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:47:25 user nova-compute[72904]:   </clock>
Aug 27 05:47:25 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:47:25 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:47:25 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:47:25 user nova-compute[72904]:   </cpu>
Aug 27 05:47:25 user nova-compute[72904]:   <devices>
Aug 27 05:47:25 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:47:25 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:47:25 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk"/>
Aug 27 05:47:25 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:47:25 user nova-compute[72904]:     </disk>
Aug 27 05:47:25 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:47:25 user nova-compute[72904]:       <mac address="fa:16:3e:1f:88:d5"/>
Aug 27 05:47:25 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:47:25 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:47:25 user nova-compute[72904]:       <target dev="tap05ce2673-4b"/>
Aug 27 05:47:25 user nova-compute[72904]:     </interface>
Aug 27 05:47:25 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:47:25 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/console.log" append="off"/>
Aug 27 05:47:25 user nova-compute[72904]:     </serial>
Aug 27 05:47:25 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:47:25 user nova-compute[72904]:     <video>
Aug 27 05:47:25 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:47:25 user nova-compute[72904]:     </video>
Aug 27 05:47:25 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:47:25 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:47:25 user nova-compute[72904]:     </rng>
Aug 27 05:47:25 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:47:25 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:47:25 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:47:25 user nova-compute[72904]:     </memballoon>
Aug 27 05:47:25 user nova-compute[72904]:   </devices>
Aug 27 05:47:25 user nova-compute[72904]: </domain>
Aug 27 05:47:25 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1408472050',display_name='tempest-VolumesSnapshotTestJSON-instance-1408472050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1408472050',id=52,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMA5uX38RAbRYCxHNXWRzRnMXweQ6xEcLOHjoCGDZ0wTVT3suqJTMVUVHoHg3th8VLmt1XgYzvIrVFoWebfylMGWDLsSByswCuWnHfyuDst+wu5zP3H2Zd9zY+7m92508w==',key_name='tempest-keypair-1901324654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33ea13632b964f2db9959ade37498fa2',ramdisk_id='',reservation_id='r-p13l5qi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-894862436',owner_user_name='tempest-VolumesSnapshotTestJSON-894862436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a78aa46042494bbaf866598102b0ec',uuid=6be48d30-3e77-47ba-8be8-a782a1c3f2ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converting VIF {"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ce2673-4b') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG os_vif [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ce2673-4b') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05ce2673-4b, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05ce2673-4b, col_values=(('external_ids', {'iface-id': '05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:88:d5', 'vm-uuid': '6be48d30-3e77-47ba-8be8-a782a1c3f2ff'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:25 user nova-compute[72904]: INFO os_vif [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ce2673-4b')
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:47:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No VIF found with MAC fa:16:3e:1f:88:d5, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:47:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updated VIF entry in instance network info cache for port 05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:47:26 user nova-compute[72904]: DEBUG nova.network.neutron [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating instance_info_cache with network_info: [{"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:47:26 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-c6081db4-af4d-48d1-b62d-555aeab633c2 req-4415208a-8929-46a5-8650-badf20a4a7af service nova] Releasing lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-b285e851-18a1-41bb-8726-5306d65891d4 req-bb4f9b76-ab20-4b81-a434-27e0777577cc service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b285e851-18a1-41bb-8726-5306d65891d4 req-bb4f9b76-ab20-4b81-a434-27e0777577cc service nova] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b285e851-18a1-41bb-8726-5306d65891d4 req-bb4f9b76-ab20-4b81-a434-27e0777577cc service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-b285e851-18a1-41bb-8726-5306d65891d4 req-bb4f9b76-ab20-4b81-a434-27e0777577cc service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG nova.compute.manager [req-b285e851-18a1-41bb-8726-5306d65891d4 req-bb4f9b76-ab20-4b81-a434-27e0777577cc service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] No waiting events found dispatching network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:47:27 user nova-compute[72904]: WARNING nova.compute.manager [req-b285e851-18a1-41bb-8726-5306d65891d4 req-bb4f9b76-ab20-4b81-a434-27e0777577cc service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received unexpected event network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d for instance with vm_state building and task_state spawning.
Aug 27 05:47:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693115249.2969792, 6be48d30-3e77-47ba-8be8-a782a1c3f2ff => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:47:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] VM Resumed (Lifecycle Event)
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:47:29 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Instance spawned successfully.
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:47:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693115249.298415, 6be48d30-3e77-47ba-8be8-a782a1c3f2ff => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:47:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] VM Started (Lifecycle Event)
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:47:29 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:47:29 user nova-compute[72904]: INFO nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-9bbefbed-6d83-4ec3-ba75-df30a1dcf568 req-9d851896-6358-4ebf-8aa4-e531628673be service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9bbefbed-6d83-4ec3-ba75-df30a1dcf568 req-9d851896-6358-4ebf-8aa4-e531628673be service nova] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9bbefbed-6d83-4ec3-ba75-df30a1dcf568 req-9d851896-6358-4ebf-8aa4-e531628673be service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-9bbefbed-6d83-4ec3-ba75-df30a1dcf568 req-9d851896-6358-4ebf-8aa4-e531628673be service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:29 user nova-compute[72904]: DEBUG nova.compute.manager [req-9bbefbed-6d83-4ec3-ba75-df30a1dcf568 req-9d851896-6358-4ebf-8aa4-e531628673be service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] No waiting events found dispatching network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:47:29 user nova-compute[72904]: WARNING nova.compute.manager [req-9bbefbed-6d83-4ec3-ba75-df30a1dcf568 req-9d851896-6358-4ebf-8aa4-e531628673be service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received unexpected event network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d for instance with vm_state building and task_state spawning.
Aug 27 05:47:29 user nova-compute[72904]: INFO nova.compute.manager [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Took 5.98 seconds to build instance.
Aug 27 05:47:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dc529bd2-4dc5-4516-b7a4-b7f9c400a834 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.070s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:47:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:47:57 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:47:57 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:47:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=25.318817138671875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:47:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:47:58 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:04 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:48:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:48:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:48:08 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:48:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:48:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:48:08 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:48:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:48:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating instance_info_cache with network_info: [{"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:48:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:48:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:48:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:48:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:48:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:48:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:48:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:48:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:48:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:48:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:48:56 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:48:57 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:48:57 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:48:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.318035125732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:48:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:48:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:04 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:49:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:49:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:09 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:49:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:49:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:49:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:49:09 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:49:09 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating instance_info_cache with network_info: [{"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-changed-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:49:14 user nova-compute[72904]: DEBUG nova.compute.manager [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Refreshing instance network info cache due to event network-changed-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:49:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] Acquiring lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:49:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] Acquired lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:49:14 user nova-compute[72904]: DEBUG nova.network.neutron [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Refreshing network info cache for port 05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updated VIF entry in instance network info cache for port 05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG nova.network.neutron [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating instance_info_cache with network_info: [{"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-60616c4a-99e5-450b-bec7-ba9bebd54fd6 req-b27388bf-5650-4cb5-8109-cd1029202904 service nova] Releasing lock "refresh_cache-6be48d30-3e77-47ba-8be8-a782a1c3f2ff" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'flavor' on Instance uuid 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:49:16 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Ignoring supplied device name: /dev/vdb
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:49:16 user nova-compute[72904]: INFO nova.compute.manager [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Attaching volume 94a76b1b-4715-48da-88ac-acdff380533b to /dev/vdb
Aug 27 05:49:16 user nova-compute[72904]: DEBUG os_brick.utils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efc1667-303b-4f36-82df-466852f6c074]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380a698-1a9a-4439-b141-39a3a17f8bf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad95bc9d-37cf-4c4b-afcf-aaae2ef04c2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99a6f10-fe91-44a7-a07b-cc715ebf3346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:49:16 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:49:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850e896-b31c-4bb4-baf3-898ac9a796da]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG os_brick.utils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:49:16 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating existing volume attachment record: 5babbd8d-a2f7-4b41-beb4-6f2c85a4a881 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:49:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdaHqFKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:49:27 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:49:27 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:49:27 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e785ea0d-8a6b-4014-afec-6186d7822fd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:49:27 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7ef3b4-d4cb-4213-a06f-205c65ecd359]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b] added
Aug 27 05:49:27 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25fac37-4460-498d-9427-60b1c56bd737]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf0ae2e-1cda-4825-8a80-d649cdb031ad]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdaHqFKP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdaHqFKP" returned: 0 in 0.031s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[229102e8-d535-42e3-bb8d-b82bc5e288ff]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DdaHqFKP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[711918ef-4225-4b85-9c78-aad73a5e68ac]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[64370254-ca05-415c-9faf-9061cf29f735]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:49:27 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:49:27 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:49:27 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:49:27 user nova-compute[72904]: 
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad7e437-b233-4e20-97a9-6cfcfbddced3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260]
Aug 27 05:49:27 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260] successful.
Aug 27 05:49:27 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd9aea3-216f-40f7-94e2-0a0ecd7cd868]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a571ec-9161-4199-90ef-015fde65da98]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b (non-flash)
Aug 27 05:49:27 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b (non-flash)
Aug 27 05:49:27 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80b4e3-4ffa-47a1-810e-9d4747025bcb]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:49:27 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdaHqFKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23737346130353465', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737346130353465', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'flavor' on Instance uuid 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:49:28 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:49:28 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:49:28 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:49:28 user nova-compute[72904]:   <serial>94a76b1b-4715-48da-88ac-acdff380533b</serial>
Aug 27 05:49:28 user nova-compute[72904]: </disk>
Aug 27 05:49:28 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:49:28 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] No VIF found with MAC fa:16:3e:1f:88:d5, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:49:29 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e371e6d7-266c-4219-a7ce-e6f8ef6ba5dc tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.657s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:49:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:49:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:49:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:32 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:36 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:41 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:46 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:51 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:49:56 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:57 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:49:58 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:49:58 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=25.309139251708984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:49:58 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:49:59 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:49:59 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:49:59 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:49:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:01 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:04 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:04 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:04 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:50:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:50:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:50:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:50:06 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:50:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:50:07 user nova-compute[72904]: INFO nova.compute.manager [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Detaching volume 94a76b1b-4715-48da-88ac-acdff380533b
Aug 27 05:50:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:50:07 user nova-compute[72904]: INFO nova.virt.block_device [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Attempting to driver detach volume 94a76b1b-4715-48da-88ac-acdff380533b from mountpoint /dev/vdb
Aug 27 05:50:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Attempting to detach device vdb from instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:50:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:50:07 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:50:07 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:50:07 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:50:07 user nova-compute[72904]:   <serial>94a76b1b-4715-48da-88ac-acdff380533b</serial>
Aug 27 05:50:07 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:50:07 user nova-compute[72904]: </disk>
Aug 27 05:50:07 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:50:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully detached device vdb from instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff from the persistent domain config.
Aug 27 05:50:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:50:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:50:07 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:50:07 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:50:07 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:50:07 user nova-compute[72904]:   <serial>94a76b1b-4715-48da-88ac-acdff380533b</serial>
Aug 27 05:50:07 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:50:07 user nova-compute[72904]: </disk>
Aug 27 05:50:07 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693115408.0794477, 6be48d30-3e77-47ba-8be8-a782a1c3f2ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:50:08 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully detached device vdb from instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff from the live domain config.
Aug 27 05:50:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdaHqFKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:50:08 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[18816e7e-5519-4a3e-9f9c-9c3d5c493e16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1306f09-f32d-46c8-9a8f-d2e10b5bee56]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b (non-flash)
Aug 27 05:50:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b (non-flash)
Aug 27 05:50:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91941d4820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[572bb438-c6da-4775-94d2-db63ba72b43a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b9ec2-0d7a-46bd-8624-b6787154b2e7]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc35fbd-7817-4075-879e-6b658c3e5d21]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fb9749-ac4d-4685-a530-ea81c9bd8d2d]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4a1c6-1270-4af0-8d90-f8b9f2809816]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9edcf4-9608-4b0d-a2ac-0356d64c1a24]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260]
Aug 27 05:50:08 user nova-compute[72904]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b, portal: 172.16.0.220,3260] successful.
Aug 27 05:50:08 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[777aa7bd-8edc-492f-84c4-2a210bc9a8ee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== disconnect_volume: return (263ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:50:08 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'flavor' on Instance uuid 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5638ad3a-1a1a-4952-9891-2afa2444ec54 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.888s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.778s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:09 user nova-compute[72904]: INFO nova.compute.manager [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Terminating instance
Aug 27 05:50:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f6ff0a8-f583-4e26-af2e-8e92bbeea83b req-428b40d2-02e6-4581-92d6-7850f7233dac service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-vif-unplugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f6ff0a8-f583-4e26-af2e-8e92bbeea83b req-428b40d2-02e6-4581-92d6-7850f7233dac service nova] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f6ff0a8-f583-4e26-af2e-8e92bbeea83b req-428b40d2-02e6-4581-92d6-7850f7233dac service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-1f6ff0a8-f583-4e26-af2e-8e92bbeea83b req-428b40d2-02e6-4581-92d6-7850f7233dac service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f6ff0a8-f583-4e26-af2e-8e92bbeea83b req-428b40d2-02e6-4581-92d6-7850f7233dac service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] No waiting events found dispatching network-vif-unplugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG nova.compute.manager [req-1f6ff0a8-f583-4e26-af2e-8e92bbeea83b req-428b40d2-02e6-4581-92d6-7850f7233dac service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-vif-unplugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 05:50:09 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Instance destroyed successfully.
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.objects.instance [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lazy-loading 'resources' on Instance uuid 6be48d30-3e77-47ba-8be8-a782a1c3f2ff {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:47:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1408472050',display_name='tempest-VolumesSnapshotTestJSON-instance-1408472050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1408472050',id=52,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMA5uX38RAbRYCxHNXWRzRnMXweQ6xEcLOHjoCGDZ0wTVT3suqJTMVUVHoHg3th8VLmt1XgYzvIrVFoWebfylMGWDLsSByswCuWnHfyuDst+wu5zP3H2Zd9zY+7m92508w==',key_name='tempest-keypair-1901324654',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33ea13632b964f2db9959ade37498fa2',ramdisk_id='',reservation_id='r-p13l5qi3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-894862436',owner_user_name='tempest-VolumesSnapshotTestJSON-894862436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='53a78aa46042494bbaf866598102b0ec',uuid=6be48d30-3e77-47ba-8be8-a782a1c3f2ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converting VIF {"id": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "address": "fa:16:3e:1f:88:d5", "network": {"id": "b0ed00f9-5450-4040-b8fc-1512ac532dd2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1833665398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33ea13632b964f2db9959ade37498fa2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05ce2673-4b", "ovs_interfaceid": "05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ce2673-4b') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_vif [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ce2673-4b') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05ce2673-4b, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:10 user nova-compute[72904]: INFO os_vif [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:88:d5,bridge_name='br-int',has_traffic_filtering=True,id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d,network=Network(b0ed00f9-5450-4040-b8fc-1512ac532dd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05ce2673-4b')
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdaHqFKP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:50:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94a76b1b-4715-48da-88ac-acdff380533b', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[742a1531-4616-4923-a671-512cccee7b9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Couldn't find iSCSI nodes because iscsiadm err: iscsiadm: No records found
Aug 27 05:50:10 user nova-compute[72904]: 
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce0ee21-2f33-49f3-b3c8-eea9d34ffb92]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:50:10 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:50:10 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:50:10 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:50:10 user nova-compute[72904]: 
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917c438d30>, {}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Disconnecting from: [] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.042s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] <== disconnect_volume: return (42ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:50:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Deleting instance files /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff_del
Aug 27 05:50:10 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Deletion of /opt/stack/data/nova/instances/6be48d30-3e77-47ba-8be8-a782a1c3f2ff_del complete
Aug 27 05:50:10 user nova-compute[72904]: INFO nova.compute.manager [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Skipping network cache update for instance because it is being deleted. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 27 05:50:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:50:11 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Took 0.91 seconds to deallocate network for instance.
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-3269781e-7ffe-45b2-abb7-e350f1011e74 req-bd39af6a-a7d7-4650-8ba6-0682f6c78ab2 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-vif-deleted-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:50:11 user nova-compute[72904]: INFO nova.compute.manager [req-3269781e-7ffe-45b2-abb7-e350f1011e74 req-bd39af6a-a7d7-4650-8ba6-0682f6c78ab2 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Neutron deleted interface 05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d; detaching it from the instance and deleting it from the info cache
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.network.neutron [req-3269781e-7ffe-45b2-abb7-e350f1011e74 req-bd39af6a-a7d7-4650-8ba6-0682f6c78ab2 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:50:11 user nova-compute[72904]: WARNING nova.volume.cinder [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Attachment 5babbd8d-a2f7-4b41-beb4-6f2c85a4a881 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5babbd8d-a2f7-4b41-beb4-6f2c85a4a881. (HTTP 404) (Request-ID: req-ffb8dd76-0eb5-42f6-aeb5-0de0dc8b9f3e)
Aug 27 05:50:11 user nova-compute[72904]: INFO nova.compute.manager [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Took 0.03 seconds to detach 1 volumes for instance.
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-3269781e-7ffe-45b2-abb7-e350f1011e74 req-bd39af6a-a7d7-4650-8ba6-0682f6c78ab2 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Detach interface failed, port_id=05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d, reason: Instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff could not be found. {{(pid=72904) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:11 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Deleted allocations for instance 6be48d30-3e77-47ba-8be8-a782a1c3f2ff
Aug 27 05:50:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-cb0c1c14-f687-40c5-b42d-d0e58213f6e1 tempest-VolumesSnapshotTestJSON-894862436 tempest-VolumesSnapshotTestJSON-894862436-project-member] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.191s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-eba7b803-981d-44df-9646-da9a247977fb req-41109221-1e1f-4582-a86d-81a7d27bb340 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received event network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eba7b803-981d-44df-9646-da9a247977fb req-41109221-1e1f-4582-a86d-81a7d27bb340 service nova] Acquiring lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eba7b803-981d-44df-9646-da9a247977fb req-41109221-1e1f-4582-a86d-81a7d27bb340 service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-eba7b803-981d-44df-9646-da9a247977fb req-41109221-1e1f-4582-a86d-81a7d27bb340 service nova] Lock "6be48d30-3e77-47ba-8be8-a782a1c3f2ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:11 user nova-compute[72904]: DEBUG nova.compute.manager [req-eba7b803-981d-44df-9646-da9a247977fb req-41109221-1e1f-4582-a86d-81a7d27bb340 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] No waiting events found dispatching network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:50:11 user nova-compute[72904]: WARNING nova.compute.manager [req-eba7b803-981d-44df-9646-da9a247977fb req-41109221-1e1f-4582-a86d-81a7d27bb340 service nova] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Received unexpected event network-vif-plugged-05ce2673-4b3b-4b41-b8bf-fbdccbb5ac8d for instance with vm_state deleted and task_state None.
Aug 27 05:50:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:50:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:50:22 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:25 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693115410.113515, 6be48d30-3e77-47ba-8be8-a782a1c3f2ff => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:50:25 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] VM Stopped (Lifecycle Event)
Aug 27 05:50:25 user nova-compute[72904]: DEBUG nova.compute.manager [None req-2c1cd633-e3ea-4dfc-bd91-aa8f49e3e35c None None] [instance: 6be48d30-3e77-47ba-8be8-a782a1c3f2ff] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:50:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:50:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:50:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:50:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:51 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:51 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:50:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:50:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:50:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:50:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:50:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:50:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:50:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:50:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:50:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:50:59 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:51:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:51:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:51:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.335948944091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:51:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:51:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:51:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:51:10 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:51:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:51:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:51:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:51:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:51:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:51:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:51:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:51:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:51:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:51:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:51:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:51:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:51:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:51:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:51:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:51:59 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:52:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:52:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:52:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=25.33468246459961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:52:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:52:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:52:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:07 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:52:11 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:52:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:52:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:52:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:52:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:25 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:26 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:30 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:35 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:52:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:52:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:52:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:52:40 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:45 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:50 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:52:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:55 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:52:59 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:52:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:52:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:52:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:52:59 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:53:00 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:53:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.3306884765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:53:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:04 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:05 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:05 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:53:07 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:53:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:53:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 05:53:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Starting instance... {{(pid=72904) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72904) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 27 05:53:15 user nova-compute[72904]: INFO nova.compute.claims [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Claim successful on node user
Aug 27 05:53:15 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Start building networks asynchronously for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Allocating IP information in the background. {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] allocate_for_instance() {{(pid=72904) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 27 05:53:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Start building block device mappings for instance. {{(pid=72904) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.policy [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f605033ab8541f9bbeee42cdfa50667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d28102e9d040b6a9953ee7185c2fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72904) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Start spawning the instance on the hypervisor. {{(pid=72904) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Creating instance directory {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 27 05:53:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Creating image(s)
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "/opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "/opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:15 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.224s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk 1073741824 {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2,backing_fmt=raw /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk 1073741824" returned: 0 in 0.057s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "a00880b1ad09db1117e0759ce506a92f5281b2f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Successfully created port: 0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a00880b1ad09db1117e0759ce506a92f5281b2f2 --force-share --output=json" returned: 0 in 0.247s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk. size=1073741824 {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG nova.virt.disk.api [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Cannot resize image /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk to a smaller size. {{(pid=72904) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Created local disks {{(pid=72904) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Ensure instance console log exists: /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/console.log {{(pid=72904) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Successfully updated port: 0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Building network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-changed-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.compute.manager [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Refreshing instance network info cache due to event network-changed-0133ad17-1647-4e19-9b88-7d90f583fff5. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Instance cache missing network info. {{(pid=72904) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Instance network_info: |[{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72904) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.network.neutron [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Refreshing network info cache for port 0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Start _get_guest_xml network_info=[{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'encryption_options': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '946923b5-2c8b-4abd-9b8c-c0df6f5e9219'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 27 05:53:17 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:53:17 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CPU controller missing on host. {{(pid=72904) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.host [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CPU controller found on host. {{(pid=72904) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 27 05:53:17 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72904) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-27T04:54:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-27T04:54:40Z,direct_url=<?>,disk_format='qcow2',id=946923b5-2c8b-4abd-9b8c-c0df6f5e9219,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='649842fbc8094e5480cd5f25d4a75c46',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-27T04:54:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Flavor limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Image limits 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Flavor pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Image pref 0:0:0 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72904) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Got 1 possible topologies {{(pid=72904) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.hardware [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72904) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1847743443',display_name='tempest-SnapshotDataIntegrityTests-server-1847743443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1847743443',id=53,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYOzMtZArEVMoUJasilcH2lS6CgnFp+Ys41BBgir87eoRzlX6fqTuqayNyWZxpecNs+gFNVgGMa+rDundCRGTl9DfKHhwxeqtLXFOpyv7GMXPe9RESrQ3aRN/MP+7BKEQ==',key_name='tempest-keypair-274066770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d28102e9d040b6a9953ee7185c2fe2',ramdisk_id='',reservation_id='r-w80g00o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-672912726',owner_user_name='tempest-SnapshotDataIntegrityTests-672912726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f605033ab8541f9bbeee42cdfa50667',uuid=f7136819-42dd-4fc9-bea3-be04775be6ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72904) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Converting VIF {"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:fd:aa,bridge_name='br-int',has_traffic_filtering=True,id=0133ad17-1647-4e19-9b88-7d90f583fff5,network=Network(d7c13b92-a3fe-4161-8ea3-bfe589e21021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0133ad17-16') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.objects.instance [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'pci_devices' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] End _get_guest_xml xml=<domain type="kvm">
Aug 27 05:53:18 user nova-compute[72904]:   <uuid>f7136819-42dd-4fc9-bea3-be04775be6ac</uuid>
Aug 27 05:53:18 user nova-compute[72904]:   <name>instance-00000035</name>
Aug 27 05:53:18 user nova-compute[72904]:   <memory>524288</memory>
Aug 27 05:53:18 user nova-compute[72904]:   <vcpu>1</vcpu>
Aug 27 05:53:18 user nova-compute[72904]:   <metadata>
Aug 27 05:53:18 user nova-compute[72904]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 27 05:53:18 user nova-compute[72904]:       <nova:package version="0.0.0"/>
Aug 27 05:53:18 user nova-compute[72904]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1847743443</nova:name>
Aug 27 05:53:18 user nova-compute[72904]:       <nova:creationTime>2023-08-27 05:53:17</nova:creationTime>
Aug 27 05:53:18 user nova-compute[72904]:       <nova:flavor name="m1.tiny">
Aug 27 05:53:18 user nova-compute[72904]:         <nova:memory>512</nova:memory>
Aug 27 05:53:18 user nova-compute[72904]:         <nova:disk>1</nova:disk>
Aug 27 05:53:18 user nova-compute[72904]:         <nova:swap>0</nova:swap>
Aug 27 05:53:18 user nova-compute[72904]:         <nova:ephemeral>0</nova:ephemeral>
Aug 27 05:53:18 user nova-compute[72904]:         <nova:vcpus>1</nova:vcpus>
Aug 27 05:53:18 user nova-compute[72904]:       </nova:flavor>
Aug 27 05:53:18 user nova-compute[72904]:       <nova:owner>
Aug 27 05:53:18 user nova-compute[72904]:         <nova:user uuid="3f605033ab8541f9bbeee42cdfa50667">tempest-SnapshotDataIntegrityTests-672912726-project-member</nova:user>
Aug 27 05:53:18 user nova-compute[72904]:         <nova:project uuid="33d28102e9d040b6a9953ee7185c2fe2">tempest-SnapshotDataIntegrityTests-672912726</nova:project>
Aug 27 05:53:18 user nova-compute[72904]:       </nova:owner>
Aug 27 05:53:18 user nova-compute[72904]:       <nova:root type="image" uuid="946923b5-2c8b-4abd-9b8c-c0df6f5e9219"/>
Aug 27 05:53:18 user nova-compute[72904]:       <nova:ports>
Aug 27 05:53:18 user nova-compute[72904]:         <nova:port uuid="0133ad17-1647-4e19-9b88-7d90f583fff5">
Aug 27 05:53:18 user nova-compute[72904]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 27 05:53:18 user nova-compute[72904]:         </nova:port>
Aug 27 05:53:18 user nova-compute[72904]:       </nova:ports>
Aug 27 05:53:18 user nova-compute[72904]:     </nova:instance>
Aug 27 05:53:18 user nova-compute[72904]:   </metadata>
Aug 27 05:53:18 user nova-compute[72904]:   <sysinfo type="smbios">
Aug 27 05:53:18 user nova-compute[72904]:     <system>
Aug 27 05:53:18 user nova-compute[72904]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 27 05:53:18 user nova-compute[72904]:       <entry name="product">OpenStack Nova</entry>
Aug 27 05:53:18 user nova-compute[72904]:       <entry name="version">0.0.0</entry>
Aug 27 05:53:18 user nova-compute[72904]:       <entry name="serial">f7136819-42dd-4fc9-bea3-be04775be6ac</entry>
Aug 27 05:53:18 user nova-compute[72904]:       <entry name="uuid">f7136819-42dd-4fc9-bea3-be04775be6ac</entry>
Aug 27 05:53:18 user nova-compute[72904]:       <entry name="family">Virtual Machine</entry>
Aug 27 05:53:18 user nova-compute[72904]:     </system>
Aug 27 05:53:18 user nova-compute[72904]:   </sysinfo>
Aug 27 05:53:18 user nova-compute[72904]:   <os>
Aug 27 05:53:18 user nova-compute[72904]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 27 05:53:18 user nova-compute[72904]:     <boot dev="hd"/>
Aug 27 05:53:18 user nova-compute[72904]:     <smbios mode="sysinfo"/>
Aug 27 05:53:18 user nova-compute[72904]:   </os>
Aug 27 05:53:18 user nova-compute[72904]:   <features>
Aug 27 05:53:18 user nova-compute[72904]:     <acpi/>
Aug 27 05:53:18 user nova-compute[72904]:     <apic/>
Aug 27 05:53:18 user nova-compute[72904]:     <vmcoreinfo/>
Aug 27 05:53:18 user nova-compute[72904]:   </features>
Aug 27 05:53:18 user nova-compute[72904]:   <clock offset="utc">
Aug 27 05:53:18 user nova-compute[72904]:     <timer name="pit" tickpolicy="delay"/>
Aug 27 05:53:18 user nova-compute[72904]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 27 05:53:18 user nova-compute[72904]:     <timer name="hpet" present="no"/>
Aug 27 05:53:18 user nova-compute[72904]:   </clock>
Aug 27 05:53:18 user nova-compute[72904]:   <cpu mode="custom" match="exact">
Aug 27 05:53:18 user nova-compute[72904]:     <model>Nehalem</model>
Aug 27 05:53:18 user nova-compute[72904]:     <topology sockets="1" cores="1" threads="1"/>
Aug 27 05:53:18 user nova-compute[72904]:   </cpu>
Aug 27 05:53:18 user nova-compute[72904]:   <devices>
Aug 27 05:53:18 user nova-compute[72904]:     <disk type="file" device="disk">
Aug 27 05:53:18 user nova-compute[72904]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 27 05:53:18 user nova-compute[72904]:       <source file="/opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk"/>
Aug 27 05:53:18 user nova-compute[72904]:       <target dev="vda" bus="virtio"/>
Aug 27 05:53:18 user nova-compute[72904]:     </disk>
Aug 27 05:53:18 user nova-compute[72904]:     <interface type="ethernet">
Aug 27 05:53:18 user nova-compute[72904]:       <mac address="fa:16:3e:d6:fd:aa"/>
Aug 27 05:53:18 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:53:18 user nova-compute[72904]:       <mtu size="1442"/>
Aug 27 05:53:18 user nova-compute[72904]:       <target dev="tap0133ad17-16"/>
Aug 27 05:53:18 user nova-compute[72904]:     </interface>
Aug 27 05:53:18 user nova-compute[72904]:     <serial type="pty">
Aug 27 05:53:18 user nova-compute[72904]:       <log file="/opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/console.log" append="off"/>
Aug 27 05:53:18 user nova-compute[72904]:     </serial>
Aug 27 05:53:18 user nova-compute[72904]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 27 05:53:18 user nova-compute[72904]:     <video>
Aug 27 05:53:18 user nova-compute[72904]:       <model type="virtio"/>
Aug 27 05:53:18 user nova-compute[72904]:     </video>
Aug 27 05:53:18 user nova-compute[72904]:     <rng model="virtio">
Aug 27 05:53:18 user nova-compute[72904]:       <backend model="random">/dev/urandom</backend>
Aug 27 05:53:18 user nova-compute[72904]:     </rng>
Aug 27 05:53:18 user nova-compute[72904]:     <controller type="usb" index="0" model="none"/>
Aug 27 05:53:18 user nova-compute[72904]:     <memballoon model="virtio">
Aug 27 05:53:18 user nova-compute[72904]:       <stats period="10"/>
Aug 27 05:53:18 user nova-compute[72904]:     </memballoon>
Aug 27 05:53:18 user nova-compute[72904]:   </devices>
Aug 27 05:53:18 user nova-compute[72904]: </domain>
Aug 27 05:53:18 user nova-compute[72904]:  {{(pid=72904) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1847743443',display_name='tempest-SnapshotDataIntegrityTests-server-1847743443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1847743443',id=53,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYOzMtZArEVMoUJasilcH2lS6CgnFp+Ys41BBgir87eoRzlX6fqTuqayNyWZxpecNs+gFNVgGMa+rDundCRGTl9DfKHhwxeqtLXFOpyv7GMXPe9RESrQ3aRN/MP+7BKEQ==',key_name='tempest-keypair-274066770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='33d28102e9d040b6a9953ee7185c2fe2',ramdisk_id='',reservation_id='r-w80g00o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-672912726',owner_user_name='tempest-SnapshotDataIntegrityTests-672912726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-27T05:53:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f605033ab8541f9bbeee42cdfa50667',uuid=f7136819-42dd-4fc9-bea3-be04775be6ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Converting VIF {"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:fd:aa,bridge_name='br-int',has_traffic_filtering=True,id=0133ad17-1647-4e19-9b88-7d90f583fff5,network=Network(d7c13b92-a3fe-4161-8ea3-bfe589e21021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0133ad17-16') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG os_vif [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:fd:aa,bridge_name='br-int',has_traffic_filtering=True,id=0133ad17-1647-4e19-9b88-7d90f583fff5,network=Network(d7c13b92-a3fe-4161-8ea3-bfe589e21021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0133ad17-16') {{(pid=72904) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0133ad17-16, may_exist=True, interface_attrs={}) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0133ad17-16, col_values=(('external_ids', {'iface-id': '0133ad17-1647-4e19-9b88-7d90f583fff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:fd:aa', 'vm-uuid': 'f7136819-42dd-4fc9-bea3-be04775be6ac'}),), if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:18 user nova-compute[72904]: INFO os_vif [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:fd:aa,bridge_name='br-int',has_traffic_filtering=True,id=0133ad17-1647-4e19-9b88-7d90f583fff5,network=Network(d7c13b92-a3fe-4161-8ea3-bfe589e21021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0133ad17-16')
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No VIF found with MAC fa:16:3e:d6:fd:aa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.network.neutron [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated VIF entry in instance network info cache for port 0133ad17-1647-4e19-9b88-7d90f583fff5. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG nova.network.neutron [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:53:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-594b2a95-c661-42f4-9e40-87e9b811b2ae req-6bcf76e7-f6cb-4898-ae20-ec943a2db3cc service nova] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:53:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:19 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-25c62d04-3733-4477-9cfa-5c2111f78e79 req-d59ba33a-7098-4815-80b0-314846220f7c service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:53:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25c62d04-3733-4477-9cfa-5c2111f78e79 req-d59ba33a-7098-4815-80b0-314846220f7c service nova] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25c62d04-3733-4477-9cfa-5c2111f78e79 req-d59ba33a-7098-4815-80b0-314846220f7c service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-25c62d04-3733-4477-9cfa-5c2111f78e79 req-d59ba33a-7098-4815-80b0-314846220f7c service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:19 user nova-compute[72904]: DEBUG nova.compute.manager [req-25c62d04-3733-4477-9cfa-5c2111f78e79 req-d59ba33a-7098-4815-80b0-314846220f7c service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] No waiting events found dispatching network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:53:19 user nova-compute[72904]: WARNING nova.compute.manager [req-25c62d04-3733-4477-9cfa-5c2111f78e79 req-d59ba33a-7098-4815-80b0-314846220f7c service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received unexpected event network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 for instance with vm_state building and task_state spawning.
Aug 27 05:53:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:20 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:53:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-679d38f1-bebb-4fae-b9af-8fad7147ae1e req-a8997aab-29c9-4b26-a86e-679fd0e9e03c service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:53:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-679d38f1-bebb-4fae-b9af-8fad7147ae1e req-a8997aab-29c9-4b26-a86e-679fd0e9e03c service nova] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:53:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-679d38f1-bebb-4fae-b9af-8fad7147ae1e req-a8997aab-29c9-4b26-a86e-679fd0e9e03c service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:53:21 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-679d38f1-bebb-4fae-b9af-8fad7147ae1e req-a8997aab-29c9-4b26-a86e-679fd0e9e03c service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:21 user nova-compute[72904]: DEBUG nova.compute.manager [req-679d38f1-bebb-4fae-b9af-8fad7147ae1e req-a8997aab-29c9-4b26-a86e-679fd0e9e03c service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] No waiting events found dispatching network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 05:53:21 user nova-compute[72904]: WARNING nova.compute.manager [req-679d38f1-bebb-4fae-b9af-8fad7147ae1e req-a8997aab-29c9-4b26-a86e-679fd0e9e03c service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received unexpected event network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 for instance with vm_state building and task_state spawning.
Aug 27 05:53:21 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693115601.9757926, f7136819-42dd-4fc9-bea3-be04775be6ac => Resumed> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:53:21 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] VM Resumed (Lifecycle Event)
Aug 27 05:53:21 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Instance event wait completed in 0 seconds for  {{(pid=72904) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 27 05:53:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Guest created on hypervisor {{(pid=72904) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 27 05:53:21 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Instance spawned successfully.
Aug 27 05:53:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Found default for hw_cdrom_bus of ide {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Found default for hw_disk_bus of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Found default for hw_input_bus of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Found default for hw_pointer_model of None {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Found default for hw_video_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Found default for hw_vif_model of virtio {{(pid=72904) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 27 05:53:22 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.virt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Emitting event <LifecycleEvent: 1693115601.9819553, f7136819-42dd-4fc9-bea3-be04775be6ac => Started> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 05:53:22 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] VM Started (Lifecycle Event)
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72904) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 27 05:53:22 user nova-compute[72904]: INFO nova.compute.manager [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 27 05:53:22 user nova-compute[72904]: INFO nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Took 6.38 seconds to spawn the instance on the hypervisor.
Aug 27 05:53:22 user nova-compute[72904]: DEBUG nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 05:53:22 user nova-compute[72904]: INFO nova.compute.manager [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Took 7.08 seconds to build instance.
Aug 27 05:53:22 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-52cb50f5-9011-49ea-a3ac-4f2a2b29ee79 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.224s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:53:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:57 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:53:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:54:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:54:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:54:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:54:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8478MB free_disk=25.289180755615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:54:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:54:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:54:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:07 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:54:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:54:15 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:54:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:54:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:54:15 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:54:15 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:54:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:54:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:54:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:54:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:54:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:54:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:54:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:54:35 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:54:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:54:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:54:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5014 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:54:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:54:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:54:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:44 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:54:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:55:02 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=25.28628158569336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:55:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:55:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:55:03 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-changed-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 05:55:06 user nova-compute[72904]: DEBUG nova.compute.manager [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Refreshing instance network info cache due to event network-changed-0133ad17-1647-4e19-9b88-7d90f583fff5. {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 27 05:55:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:55:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:55:06 user nova-compute[72904]: DEBUG nova.network.neutron [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Refreshing network info cache for port 0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 27 05:55:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated VIF entry in instance network info cache for port 0133ad17-1647-4e19-9b88-7d90f583fff5. {{(pid=72904) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 27 05:55:07 user nova-compute[72904]: DEBUG nova.network.neutron [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:55:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-270ab8e9-894b-46cc-bc1d-a5fabce9d469 req-c95b523f-fa88-4b64-9d59-11f3722e1c6d service nova] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:55:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:09 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:09 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:09 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG nova.objects.instance [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:55:12 user nova-compute[72904]: INFO nova.compute.manager [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attaching volume 36a77ce9-21b0-42dd-8164-96d52dc0e1b0 to /dev/vdb
Aug 27 05:55:12 user nova-compute[72904]: DEBUG os_brick.utils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4adf21-4287-4bcf-bdb9-07b624c67dae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57d0a45-8546-41e4-8200-5abc72edece1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa50d01c-7953-478f-85c0-d58d8dc74d9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f7652-83be-4cab-ba8d-346d4fbf7010]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:55:12 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:55:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a05dbe-004d-4767-8aae-860fe901880d]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:55:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:55:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:55:13 user nova-compute[72904]: DEBUG os_brick.utils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:55:13 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating existing volume attachment record: b265d521-386c-46e1-877c-01821e124939 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:55:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:15 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:55:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:55:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:55:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:55:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:55:16 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:55:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:55:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:55:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:55:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:18 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:19 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:22 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAUrLKwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:55:23 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:55:23 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:55:23 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a94f868-64d1-4f7d-b3ae-71ef32e3b6ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:55:23 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dabb2d4-febc-49d1-9ad7-09e218eeda39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0] added
Aug 27 05:55:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e850e9-4a9e-442d-b0b1-b4e7c5195ab6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3ac051-953d-4175-98aa-f79c76141cee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAUrLKwR {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EAUrLKwR" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab6908e-0f59-4b26-b2ba-a01ecd81be01]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EAUrLKwR'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[933f2365-cc35-4c8d-ad7e-cffb286e39e6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6b17a5-745d-4b2a-b504-acf3702581f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:55:23 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:55:23 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:55:23 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:55:23 user nova-compute[72904]: 
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a31216-2501-47af-98e4-ac9f0b6e1ba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260]
Aug 27 05:55:23 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260] successful.
Aug 27 05:55:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee58b25f-1cd1-42d9-9b71-9785a1015ed5]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2018c75-1c11-4c13-9c67-d05d21e14245]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 (non-flash)
Aug 27 05:55:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 (non-flash)
Aug 27 05:55:23 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a4c86-76d9-4c89-a0c7-4d889927e283]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:55:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAUrLKwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:55:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:55:24 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23534353139626535', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:55:24 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534353139626535', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:55:25 user nova-compute[72904]: DEBUG nova.objects.instance [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:55:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:55:25 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:55:25 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:55:25 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:55:25 user nova-compute[72904]:   <serial>36a77ce9-21b0-42dd-8164-96d52dc0e1b0</serial>
Aug 27 05:55:25 user nova-compute[72904]: </disk>
Aug 27 05:55:25 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:55:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:55:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:55:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No VIF found with MAC fa:16:3e:d6:fd:aa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:55:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-616fa657-8ea3-4ffa-b17b-0da796e63d12 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.775s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:55:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 05:55:26 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 05:55:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:55:36 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_power_states {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:36 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Triggering sync for uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 27 05:55:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:55:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:55:36 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:55:37 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:42 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:47 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:54 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:55:54 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 05:55:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:55:57 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:55:57 user nova-compute[72904]: INFO nova.compute.manager [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Detaching volume 36a77ce9-21b0-42dd-8164-96d52dc0e1b0
Aug 27 05:55:57 user nova-compute[72904]: INFO nova.virt.block_device [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attempting to driver detach volume 36a77ce9-21b0-42dd-8164-96d52dc0e1b0 from mountpoint /dev/vdb
Aug 27 05:55:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Attempting to detach device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:55:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:55:57 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:55:57 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:55:57 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:55:57 user nova-compute[72904]:   <serial>36a77ce9-21b0-42dd-8164-96d52dc0e1b0</serial>
Aug 27 05:55:57 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:55:57 user nova-compute[72904]: </disk>
Aug 27 05:55:57 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:55:57 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config.
Aug 27 05:55:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:55:57 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:55:57 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:55:57 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:55:57 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:55:57 user nova-compute[72904]:   <serial>36a77ce9-21b0-42dd-8164-96d52dc0e1b0</serial>
Aug 27 05:55:57 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:55:57 user nova-compute[72904]: </disk>
Aug 27 05:55:57 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693115758.162282, f7136819-42dd-4fc9-bea3-be04775be6ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:55:58 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config.
Aug 27 05:55:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EAUrLKwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:55:58 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dd17cd-e4d2-4520-be30-10c3be679d7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[493f5d55-3d53-4775-a265-fbc149ff993c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 (non-flash)
Aug 27 05:55:58 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 (non-flash)
Aug 27 05:55:58 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91942a7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c15859c-7986-4c7d-a18f-481a773269b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0026c757-b4ba-4cad-ba18-e458f2a9b96c]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dab0c6-ba05-42fe-89db-83da2073d350]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[262341ad-b265-4717-a860-d529cee7991d]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c7afe-bf8a-4e9a-b533-18f88b636d4c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8194bd-b37a-4b0d-b514-b92530edf79b]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260]
Aug 27 05:55:58 user nova-compute[72904]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0, portal: 172.16.0.220,3260] successful.
Aug 27 05:55:58 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36a77ce9-21b0-42dd-8164-96d52dc0e1b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9cb5e1-2d13-4867-aaee-58d7daa5b1b6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== disconnect_volume: return (248ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:55:58 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:55:59 user nova-compute[72904]: DEBUG nova.objects.instance [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:55:59 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-4a786283-34ab-40c4-b477-665a7902bc47 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:56:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:56:03 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:56:03 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8761MB free_disk=25.28445816040039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:56:03 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:56:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:09 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:11 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:56:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:56:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:56:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:56:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:56:16 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:56:16 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:56:16 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:56:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:56:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:56:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:56:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:56:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:56:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:56:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:56:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:56:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:56:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:56:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:56:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:56:51 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:56:51 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:56:52 user nova-compute[72904]: INFO nova.compute.manager [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attaching volume 563e2537-e781-4180-9d67-a53afb9eacf2 to /dev/vdb
Aug 27 05:56:52 user nova-compute[72904]: DEBUG os_brick.utils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdac2d54-da23-4754-a5da-10fefa2e2643]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8094fd3-47ea-47ff-87fa-c987c5f46456]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfdfe08-f82a-4a94-9ab6-f518b4ae6a07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[03af980b-7f15-43bb-8ed0-17500599c767]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:56:52 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:56:52 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcd5010-64af-4b18-a516-9d18b7d09813]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG os_brick.utils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating existing volume attachment record: f1a443cf-845a-4fdd-a1c3-fa9f54697371 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:56:52 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:56:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:56:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:56:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:56:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MniIshpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:57:02 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:57:02 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:57:02 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9a58e5-3982-4aca-932c-655385c74db3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:57:02 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d820008a-3c1e-4673-870c-bcf307e369b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2] added
Aug 27 05:57:02 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a6afec-5ef6-404f-a3a9-e854e5acaa63]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a85db58-1cad-42f0-85c7-fd79b4bf18ee]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MniIshpF {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MniIshpF" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[21755cec-a06f-4c20-b02b-7448ff727e02]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MniIshpF'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d352d78-c012-421b-a2b9-bc40f852afa1]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[76671213-fe3c-468b-aa0e-5b08b6c3f2df]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:57:02 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:57:02 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:57:02 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:57:02 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:57:02 user nova-compute[72904]: 
Aug 27 05:57:02 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e4eef-70c4-454f-a67d-f8470c27c5f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260]
Aug 27 05:57:03 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260] successful.
Aug 27 05:57:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff5c803-1b3b-4867-a8e3-159b51f90747]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa2c248-aca9-40ed-b64c-959c1f8f50b1]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 (non-flash)
Aug 27 05:57:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 (non-flash)
Aug 27 05:57:03 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7d3e24-3802-45fd-a5b4-cd73f2b801a1]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:57:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MniIshpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23332346530383037', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332346530383037', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG nova.objects.instance [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:57:04 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:57:04 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:57:04 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:57:04 user nova-compute[72904]:   <serial>563e2537-e781-4180-9d67-a53afb9eacf2</serial>
Aug 27 05:57:04 user nova-compute[72904]: </disk>
Aug 27 05:57:04 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No VIF found with MAC fa:16:3e:d6:fd:aa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-f1f169cb-0d74-45f4-840a-e3f413f9f2a2 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.551s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:04 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72904) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 27 05:57:05 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:57:05 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=25.26797103881836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:57:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:57:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:57:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:57:06 user nova-compute[72904]: INFO nova.compute.manager [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Detaching volume 563e2537-e781-4180-9d67-a53afb9eacf2
Aug 27 05:57:06 user nova-compute[72904]: INFO nova.virt.block_device [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attempting to driver detach volume 563e2537-e781-4180-9d67-a53afb9eacf2 from mountpoint /dev/vdb
Aug 27 05:57:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Attempting to detach device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:57:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:57:06 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:57:06 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:57:06 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:57:06 user nova-compute[72904]:   <serial>563e2537-e781-4180-9d67-a53afb9eacf2</serial>
Aug 27 05:57:06 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:57:06 user nova-compute[72904]: </disk>
Aug 27 05:57:06 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:57:06 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config.
Aug 27 05:57:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:57:06 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:57:06 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:57:06 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:57:06 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:57:06 user nova-compute[72904]:   <serial>563e2537-e781-4180-9d67-a53afb9eacf2</serial>
Aug 27 05:57:06 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:57:06 user nova-compute[72904]: </disk>
Aug 27 05:57:06 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693115827.39981, f7136819-42dd-4fc9-bea3-be04775be6ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:57:07 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config.
Aug 27 05:57:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MniIshpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:57:07 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[db654e00-75ac-43e5-80b9-61f030dd8b2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d0a95d-7366-43a8-ada9-7bd6bc0d37dd]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 (non-flash)
Aug 27 05:57:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 (non-flash)
Aug 27 05:57:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91942bb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19a8294-b0b6-4a3f-9eb2-525f55e67684]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0b804e-c83f-4309-8b12-df4c45f2703d]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a5d4be-4310-4cdd-a0b8-d8838b56d5ec]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e83c1a-39db-4b8e-be14-f286bb2b6aae]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8060df-124c-4b9b-a8f6-d8c1082a0aa6]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[296f2b57-236b-4805-b287-571a2638fccc]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260]
Aug 27 05:57:07 user nova-compute[72904]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2, portal: 172.16.0.220,3260] successful.
Aug 27 05:57:07 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:563e2537-e781-4180-9d67-a53afb9eacf2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[827da589-4879-4d8d-8862-39119b3b0131]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== disconnect_volume: return (268ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:08 user nova-compute[72904]: DEBUG nova.objects.instance [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:57:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-48a61dbe-d0e0-4b78-b1d6-ab234a49d203 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:57:10 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:11 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:11 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:57:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:57:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:57:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:57:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:57:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:57:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:57:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:57:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:57:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:22 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:57:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:57:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:57:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:57:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:57:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:57:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:58:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:58:00 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:58:00 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:58:01 user nova-compute[72904]: INFO nova.compute.manager [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attaching volume b9d53063-2b14-47f3-ba55-b6665406be27 to /dev/vdb
Aug 27 05:58:01 user nova-compute[72904]: DEBUG os_brick.utils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c6bf12-2359-4b1a-995b-a19b30ccc890]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8554d0-d1ba-46c2-905e-1c6f3b189bfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bc2e7e-5ec8-47b8-a487-9d747b0d6715]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9f238b-12cf-494c-a064-6deaff17b483]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:58:01 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:58:01 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c640cc8-2e1f-420f-8f44-59b10c756292]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG os_brick.utils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:58:01 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating existing volume attachment record: 5f66414a-e4f7-40e6-8bb5-cf9de5ea4071 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:58:02 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:05 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:06 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:58:06 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:58:06 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8771MB free_disk=25.267051696777344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:58:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:58:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:58:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:58:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:58:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:58:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:09 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEaIMQXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:58:12 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:58:12 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:58:12 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aadc15-62e4-4f7c-ad83-867732acc71b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:58:12 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7036382-3f49-4e66-a62f-f38d5e65f26a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27] added
Aug 27 05:58:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7216ab-14b0-471b-a35f-4961215000e2]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc11bf76-c98b-4f64-a45a-f9dc6fca7807]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEaIMQXU {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEaIMQXU" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e5b1f7-5dd8-4ac9-8c30-0a8994a55f78]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEaIMQXU'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e227f465-963d-467e-9e1a-57193151a5a0]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[98893b76-d3b2-4ad1-a819-fe3089fa57d7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:58:12 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:58:12 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:58:12 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:58:12 user nova-compute[72904]: 
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa2db4d-2fe8-4b20-ad0a-b1edb4012fe8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260]
Aug 27 05:58:12 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260] successful.
Aug 27 05:58:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4881ca-81e4-4212-9634-b6c16e6b34e7]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[18143aed-97a1-42be-97c8-ed4e13fe2937]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 (non-flash)
Aug 27 05:58:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 (non-flash)
Aug 27 05:58:12 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[316d5e0e-1594-4393-89ca-62cff54587aa]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEaIMQXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23862663036373831', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862663036373831', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG nova.objects.instance [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:58:13 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:58:13 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:58:13 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:58:13 user nova-compute[72904]:   <serial>b9d53063-2b14-47f3-ba55-b6665406be27</serial>
Aug 27 05:58:13 user nova-compute[72904]: </disk>
Aug 27 05:58:13 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No VIF found with MAC fa:16:3e:d6:fd:aa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:58:13 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-ba21ca22-17e8-42af-b883-73392e9d316b tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.944s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:58:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:58:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:58:15 user nova-compute[72904]: INFO nova.compute.manager [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Detaching volume b9d53063-2b14-47f3-ba55-b6665406be27
Aug 27 05:58:15 user nova-compute[72904]: INFO nova.virt.block_device [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attempting to driver detach volume b9d53063-2b14-47f3-ba55-b6665406be27 from mountpoint /dev/vdb
Aug 27 05:58:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Attempting to detach device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:58:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:58:15 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:58:15 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:58:15 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:58:15 user nova-compute[72904]:   <serial>b9d53063-2b14-47f3-ba55-b6665406be27</serial>
Aug 27 05:58:15 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:58:15 user nova-compute[72904]: </disk>
Aug 27 05:58:15 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:58:15 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config.
Aug 27 05:58:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:58:15 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:58:15 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:58:15 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:58:15 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:58:15 user nova-compute[72904]:   <serial>b9d53063-2b14-47f3-ba55-b6665406be27</serial>
Aug 27 05:58:15 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:58:15 user nova-compute[72904]: </disk>
Aug 27 05:58:15 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693115896.233604, f7136819-42dd-4fc9-bea3-be04775be6ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:58:16 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config.
Aug 27 05:58:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEaIMQXU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:58:16 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d878647a-b91f-455b-998a-5c6ddc1abc8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[19787365-d145-4748-9fea-08d829f2496f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 (non-flash)
Aug 27 05:58:16 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 (non-flash)
Aug 27 05:58:16 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91943f5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe543e-69e1-4005-90d3-dab00e1ecd7c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[7365402b-36b3-42a9-bc6b-41ba2cf5831c]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8e679d-4598-4d94-a001-d052e77d312c]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[26086042-09e2-4ece-a004-6a6c55263b22]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad1dc14-206f-440a-afcb-31ac7701880e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b8d61e-8d8d-46f0-9f92-c9a328247869]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260]
Aug 27 05:58:16 user nova-compute[72904]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27, portal: 172.16.0.220,3260] successful.
Aug 27 05:58:16 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d53063-2b14-47f3-ba55-b6665406be27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[003e5d2a-f362-428d-b0f2-d2aa257e4cbf]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== disconnect_volume: return (250ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:58:16 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-5a7f80b1-9641-40f7-8f9d-95980b1f1774 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.683s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:58:17 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:58:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:58:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:58:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:58:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:58:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:58:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:58:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:23 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:58:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:58:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:58:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:58:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:58:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:07 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:59:07 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 05:59:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=25.26608657836914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 05:59:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.164s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:59:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:59:10 user nova-compute[72904]: DEBUG nova.objects.instance [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:59:10 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:59:11 user nova-compute[72904]: INFO nova.compute.manager [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attaching volume f81f89b1-796b-4ce2-91ff-d522269077d6 to /dev/vdb
Aug 27 05:59:11 user nova-compute[72904]: DEBUG os_brick.utils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c9abf6-4da9-4fe6-a352-52e32958382c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:86d431ed68aa\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfe2cde-5d43-47bd-89ef-88f2199542a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a91afc3-ea0b-4dd2-b575-ed4a22916ad5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee55098-4531-42af-a6bf-af04e3d88d42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Running cmd (subprocess): nvme version {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] 'nvme version' failed. Not Retrying. {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] nvme not present on system {{(pid=72904) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 27 05:59:11 user nova-compute[72904]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[69fa7e8d-095c-482e-92f0-47d78bcbb17e]: (4, '') {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72904) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.lightos [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] LIGHTOS: no hostnqn found. {{(pid=72904) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG os_brick.utils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:86d431ed68aa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG nova.virt.block_device [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating existing volume attachment record: 01d6599f-f2e9-4d1c-a6ff-07a8d77caa91 {{(pid=72904) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 27 05:59:11 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:13 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 05:59:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 05:59:17 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 05:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 05:59:17 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 05:59:17 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 05:59:17 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:19 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Calling os-brick to attach iSCSI Volume {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPHghplG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:59:21 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:59:21 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:59:21 user nova-compute[72904]: INFO os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[602c951a-dcc8-496b-95ba-6b1262612990]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 27 05:59:21 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a0c715-a527-43da-98d1-848dbaac3890]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6] added\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6] added
Aug 27 05:59:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f2a029-e271-4de3-a9cc-e067bcc3090e]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce00632-098d-4c64-aeb6-455d4b269339]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPHghplG {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPHghplG" returned: 0 in 0.023s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54d0b46-3904-41bd-a719-0e1722e8dd61]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FPHghplG'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecafc60-9c08-4d9f-b4e8-d92f52d98a84]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[d261a350-a021-45c7-be0f-150ca9feb687]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:59:21 user nova-compute[72904]:  {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 27 05:59:21 user nova-compute[72904]:  {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:59:21 user nova-compute[72904]: WARNING os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 27 05:59:21 user nova-compute[72904]: 
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --login {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[693332c9-0d91-4ea7-9d53-3a6070570894]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260]
Aug 27 05:59:21 user nova-compute[72904]: Login to [iface: default, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260] successful.
Aug 27 05:59:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[87865414-1ddb-43dd-af38-86e32fb67537]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[5156aed5-0b31-45cb-8c02-4d1279645f0d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 (non-flash)
Aug 27 05:59:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 (non-flash)
Aug 27 05:59:21 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to 172.16.0.220:3260 {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72904) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72904) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 27 05:59:21 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:22 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:22 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e5c759-87be-4a66-be67-5d06c1c5b456]: (4, ('- - 0', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:22 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72904) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 27 05:59:22 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPHghplG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72904) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '23835653136353435', 'path': '/dev/sdb'} {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835653136353435', 'path': '/dev/sdb'} {{(pid=72904) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG nova.objects.instance [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] attach device xml: <disk type="block" device="disk">
Aug 27 05:59:23 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:59:23 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:59:23 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:59:23 user nova-compute[72904]:   <serial>f81f89b1-796b-4ce2-91ff-d522269077d6</serial>
Aug 27 05:59:23 user nova-compute[72904]: </disk>
Aug 27 05:59:23 user nova-compute[72904]:  {{(pid=72904) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vda, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72904) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] No VIF found with MAC fa:16:3e:d6:fd:aa, not building metadata {{(pid=72904) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-8bf76109-db02-4d06-9b8c-0c8125c98cb4 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.539s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:59:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:24 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 05:59:25 user nova-compute[72904]: INFO nova.compute.manager [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Detaching volume f81f89b1-796b-4ce2-91ff-d522269077d6
Aug 27 05:59:25 user nova-compute[72904]: INFO nova.virt.block_device [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Attempting to driver detach volume f81f89b1-796b-4ce2-91ff-d522269077d6 from mountpoint /dev/vdb
Aug 27 05:59:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Attempting to detach device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config. {{(pid=72904) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:59:25 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:59:25 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:59:25 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:59:25 user nova-compute[72904]:   <serial>f81f89b1-796b-4ce2-91ff-d522269077d6</serial>
Aug 27 05:59:25 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:59:25 user nova-compute[72904]: </disk>
Aug 27 05:59:25 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:59:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the persistent domain config.
Aug 27 05:59:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config. {{(pid=72904) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.guest [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] detach device xml: <disk type="block" device="disk">
Aug 27 05:59:25 user nova-compute[72904]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 27 05:59:25 user nova-compute[72904]:   <source dev="/dev/sdb"/>
Aug 27 05:59:25 user nova-compute[72904]:   <target dev="vdb" bus="virtio"/>
Aug 27 05:59:25 user nova-compute[72904]:   <serial>f81f89b1-796b-4ce2-91ff-d522269077d6</serial>
Aug 27 05:59:25 user nova-compute[72904]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 27 05:59:25 user nova-compute[72904]: </disk>
Aug 27 05:59:25 user nova-compute[72904]:  {{(pid=72904) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-6702e9a5-6ee2-4149-b0f9-399529f7f867 None None] Received event <DeviceRemovedEvent: 1693115965.9577725, f7136819-42dd-4fc9-bea3-be04775be6ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72904) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.driver [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 27 05:59:25 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully detached device vdb from instance f7136819-42dd-4fc9-bea3-be04775be6ac from the live domain config.
Aug 27 05:59:25 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] calling os-brick to detach iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f919418d570>, {'target_iqns': ['iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPHghplG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 27 05:59:25 user nova-compute[72904]: WARNING os_brick.initiator.connectors.base [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 27 05:59:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6', 0)] {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b2cf08-8640-454a-8a77-180c283fcff8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:25 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6549d2-3af3-4a01-8078-9f9b067b0890]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 (non-flash)\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 (non-flash)
Aug 27 05:59:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 (non-flash)
Aug 27 05:59:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9194536a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6'): ({'sdb'}, set())}) {{(pid=72904) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Removing single pathed devices sdb {{(pid=72904) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[807492b1-6a91-403f-aa29-963f3a146b52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196a4da-f33f-4f7b-9bfd-20f5c3f7ea02]: (4, ('ok\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Flushing IO for device /dev/sdb {{(pid=72904) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd154416-024f-4192-a970-4cc49b632c84]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72904) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.028s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3deaa7-619d-4914-b526-aec31bae1b2a]: (4, ('1', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.linuxscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] SCSI volumes sdb have been removed. {{(pid=72904) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6')] {{(pid=72904) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[85242fea-6a58-4440-ba0a-f21f6f2a6b71]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --logout {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[b402c23c-2af3-46c7-907d-4a1c71f9caff]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260]
Aug 27 05:59:26 user nova-compute[72904]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6, portal: 172.16.0.220,3260] successful.
Aug 27 05:59:26 user nova-compute[72904]:  stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op delete {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81f89b1-796b-4ce2-91ff-d522269077d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84216) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo.privsep.daemon [-] privsep: reply[12480ebd-0f28-45d3-bf7b-1ec99c758c40]: (4, ('', '')) {{(pid=84216) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72904) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.base [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] <== disconnect_volume: return (246ms) None {{(pid=72904) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Disconnected iSCSI Volume {{(pid=72904) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 05:59:27 user nova-compute[72904]: DEBUG nova.objects.instance [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'flavor' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 05:59:27 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-dcb7b8e3-dcc4-4acf-a49e-3bd4e91363a1 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 05:59:27 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:59:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:59:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:59:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 05:59:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 05:59:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 05:59:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 05:59:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:00:06 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:00:07 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:00:07 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=25.257381439208984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing inventories for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating ProviderTree inventory for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Updating inventory in ProviderTree for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing aggregate associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, aggregates: None {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Refreshing trait associations for resource provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6, traits: HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO {{(pid=72904) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:00:07 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:00:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:11 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:00:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:00:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:19 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:00:19 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 27 06:00:19 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquired lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 27 06:00:19 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Forcefully refreshing network info cache for instance {{(pid=72904) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 27 06:00:19 user nova-compute[72904]: DEBUG nova.objects.instance [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lazy-loading 'info_cache' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:00:20 user nova-compute[72904]: DEBUG nova.network.neutron [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [{"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:00:20 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Releasing lock "refresh_cache-f7136819-42dd-4fc9-bea3-be04775be6ac" {{(pid=72904) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 27 06:00:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updated the network info_cache for instance {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 27 06:00:21 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:00:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:27 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:28 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:32 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 27 06:00:32 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] There are 0 instances to clean {{(pid=72904) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 27 06:00:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:00:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:34 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:00:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:00:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:00:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:00:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:00:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:00:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:07 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:07 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Cleaning up deleted instances with incomplete migration  {{(pid=72904) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:01:08 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.processutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72904) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 27 06:01:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:01:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:01:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.256351470947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Instance f7136819-42dd-4fc9-bea3-be04775be6ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72904) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:01:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:01:12 user nova-compute[72904]: INFO nova.compute.manager [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Terminating instance
Aug 27 06:01:12 user nova-compute[72904]: DEBUG nova.compute.manager [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Start destroying the instance on the hypervisor. {{(pid=72904) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3bf5cf4-7577-4766-8f95-a14bc6ba0a66 req-f6806f48-ecda-4772-b136-8a0f15b3b75d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-vif-unplugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3bf5cf4-7577-4766-8f95-a14bc6ba0a66 req-f6806f48-ecda-4772-b136-8a0f15b3b75d service nova] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3bf5cf4-7577-4766-8f95-a14bc6ba0a66 req-f6806f48-ecda-4772-b136-8a0f15b3b75d service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e3bf5cf4-7577-4766-8f95-a14bc6ba0a66 req-f6806f48-ecda-4772-b136-8a0f15b3b75d service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3bf5cf4-7577-4766-8f95-a14bc6ba0a66 req-f6806f48-ecda-4772-b136-8a0f15b3b75d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] No waiting events found dispatching network-vif-unplugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG nova.compute.manager [req-e3bf5cf4-7577-4766-8f95-a14bc6ba0a66 req-f6806f48-ecda-4772-b136-8a0f15b3b75d service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-vif-unplugged-0133ad17-1647-4e19-9b88-7d90f583fff5 for instance with task_state deleting. {{(pid=72904) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 27 06:01:12 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [-] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Instance destroyed successfully.
Aug 27 06:01:13 user nova-compute[72904]: DEBUG nova.objects.instance [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lazy-loading 'resources' on Instance uuid f7136819-42dd-4fc9-bea3-be04775be6ac {{(pid=72904) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG nova.virt.libvirt.vif [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-27T05:53:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1847743443',display_name='tempest-SnapshotDataIntegrityTests-server-1847743443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1847743443',id=53,image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYOzMtZArEVMoUJasilcH2lS6CgnFp+Ys41BBgir87eoRzlX6fqTuqayNyWZxpecNs+gFNVgGMa+rDundCRGTl9DfKHhwxeqtLXFOpyv7GMXPe9RESrQ3aRN/MP+7BKEQ==',key_name='tempest-keypair-274066770',keypairs=<?>,launch_index=0,launched_at=2023-08-27T05:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='33d28102e9d040b6a9953ee7185c2fe2',ramdisk_id='',reservation_id='r-w80g00o8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='946923b5-2c8b-4abd-9b8c-c0df6f5e9219',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-672912726',owner_user_name='tempest-SnapshotDataIntegrityTests-672912726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-27T05:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f605033ab8541f9bbeee42cdfa50667',uuid=f7136819-42dd-4fc9-bea3-be04775be6ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Converting VIF {"id": "0133ad17-1647-4e19-9b88-7d90f583fff5", "address": "fa:16:3e:d6:fd:aa", "network": {"id": "d7c13b92-a3fe-4161-8ea3-bfe589e21021", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1306799583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "33d28102e9d040b6a9953ee7185c2fe2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0133ad17-16", "ovs_interfaceid": "0133ad17-1647-4e19-9b88-7d90f583fff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG nova.network.os_vif_util [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:fd:aa,bridge_name='br-int',has_traffic_filtering=True,id=0133ad17-1647-4e19-9b88-7d90f583fff5,network=Network(d7c13b92-a3fe-4161-8ea3-bfe589e21021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0133ad17-16') {{(pid=72904) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG os_vif [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:fd:aa,bridge_name='br-int',has_traffic_filtering=True,id=0133ad17-1647-4e19-9b88-7d90f583fff5,network=Network(d7c13b92-a3fe-4161-8ea3-bfe589e21021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0133ad17-16') {{(pid=72904) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0133ad17-16, bridge=br-int, if_exists=True) {{(pid=72904) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:13 user nova-compute[72904]: INFO os_vif [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:fd:aa,bridge_name='br-int',has_traffic_filtering=True,id=0133ad17-1647-4e19-9b88-7d90f583fff5,network=Network(d7c13b92-a3fe-4161-8ea3-bfe589e21021),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0133ad17-16')
Aug 27 06:01:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Deleting instance files /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac_del
Aug 27 06:01:13 user nova-compute[72904]: INFO nova.virt.libvirt.driver [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Deletion of /opt/stack/data/nova/instances/f7136819-42dd-4fc9-bea3-be04775be6ac_del complete
Aug 27 06:01:13 user nova-compute[72904]: INFO nova.compute.manager [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 27 06:01:13 user nova-compute[72904]: DEBUG oslo.service.loopingcall [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72904) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG nova.compute.manager [-] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Deallocating network for instance {{(pid=72904) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] deallocate_for_instance() {{(pid=72904) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 27 06:01:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:14 user nova-compute[72904]: DEBUG nova.network.neutron [-] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Updating instance_info_cache with network_info: [] {{(pid=72904) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 27 06:01:14 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Took 0.84 seconds to deallocate network for instance.
Aug 27 06:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:01:14 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:01:14 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:01:14 user nova-compute[72904]: INFO nova.scheduler.client.report [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Deleted allocations for instance f7136819-42dd-4fc9-bea3-be04775be6ac
Aug 27 06:01:14 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-e48db77e-d113-4eda-8e7d-6992e0076438 tempest-SnapshotDataIntegrityTests-672912726 tempest-SnapshotDataIntegrityTests-672912726-project-member] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:01:14 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:14 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-e87072d9-8139-48d3-85a4-06488c708e73 req-c7b1a10c-0cc0-4d1d-a9b7-aa8fcf3c49f7 service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e87072d9-8139-48d3-85a4-06488c708e73 req-c7b1a10c-0cc0-4d1d-a9b7-aa8fcf3c49f7 service nova] Acquiring lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e87072d9-8139-48d3-85a4-06488c708e73 req-c7b1a10c-0cc0-4d1d-a9b7-aa8fcf3c49f7 service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:01:15 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [req-e87072d9-8139-48d3-85a4-06488c708e73 req-c7b1a10c-0cc0-4d1d-a9b7-aa8fcf3c49f7 service nova] Lock "f7136819-42dd-4fc9-bea3-be04775be6ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-e87072d9-8139-48d3-85a4-06488c708e73 req-c7b1a10c-0cc0-4d1d-a9b7-aa8fcf3c49f7 service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] No waiting events found dispatching network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 27 06:01:15 user nova-compute[72904]: WARNING nova.compute.manager [req-e87072d9-8139-48d3-85a4-06488c708e73 req-c7b1a10c-0cc0-4d1d-a9b7-aa8fcf3c49f7 service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received unexpected event network-vif-plugged-0133ad17-1647-4e19-9b88-7d90f583fff5 for instance with vm_state deleted and task_state None.
Aug 27 06:01:15 user nova-compute[72904]: DEBUG nova.compute.manager [req-e87072d9-8139-48d3-85a4-06488c708e73 req-c7b1a10c-0cc0-4d1d-a9b7-aa8fcf3c49f7 service nova] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Received event network-vif-deleted-0133ad17-1647-4e19-9b88-7d90f583fff5 {{(pid=72904) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 27 06:01:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:01:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:01:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:01:22 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:28 user nova-compute[72904]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693116073.2049186, f7136819-42dd-4fc9-bea3-be04775be6ac => Stopped> {{(pid=72904) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 27 06:01:28 user nova-compute[72904]: INFO nova.compute.manager [-] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] VM Stopped (Lifecycle Event)
Aug 27 06:01:28 user nova-compute[72904]: DEBUG nova.compute.manager [None req-fbb0ad86-f8a0-4ddc-8931-f7c834b79ea6 None None] [instance: f7136819-42dd-4fc9-bea3-be04775be6ac] Checking state {{(pid=72904) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 27 06:01:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:01:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:01:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:01:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:29 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:01:33 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:38 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:43 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:01:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72904) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 27 06:01:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:01:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72904) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 27 06:01:48 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:53 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:01:58 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:02:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:02:03 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:02:07 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:02:08 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:02:08 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager.update_available_resource {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:02:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:02:08 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:02:08 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=72904) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 27 06:02:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:02:09 user nova-compute[72904]: WARNING nova.virt.libvirt.driver [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 27 06:02:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.283199310302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72904) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72904) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG nova.compute.provider_tree [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed in ProviderTree for provider: 5171e224-87c1-41ec-9fd6-f1643cc7adc6 {{(pid=72904) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG nova.scheduler.client.report [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Inventory has not changed for provider 5171e224-87c1-41ec-9fd6-f1643cc7adc6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72904) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG nova.compute.resource_tracker [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Compute_service record updated for user:user {{(pid=72904) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 27 06:02:09 user nova-compute[72904]: DEBUG oslo_concurrency.lockutils [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72904) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 27 06:02:10 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:02:13 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:13 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 27 06:02:16 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:16 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72904) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 27 06:02:17 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:18 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:02:20 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Starting heal instance info cache {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 27 06:02:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Rebuilding the list of instances to heal {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 27 06:02:20 user nova-compute[72904]: DEBUG nova.compute.manager [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Didn't find any instances for network info cache update. {{(pid=72904) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 27 06:02:22 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:23 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:02:26 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:28 user nova-compute[72904]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72904) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 27 06:02:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 27 06:02:31 user nova-compute[72904]: DEBUG oslo_service.periodic_task [None req-a1b142be-a706-475f-b300-342ae3665f2a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72904) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}